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' EXECUTIVE SUMMARY 

• - 

S ' 

The. Youth Employment Demonstration Projects Act of 1977 
concentrated a large sum of Federal research and program 
monies on 'assisting disadvantaged youth tc enter the world 
of work. In addition to formula-funded programs adminis- 
tered by CETA prime sponsors, the legislation committed sub- 
stantial resources to testing new approaches, to alleviating 
youth unemployment. Early in 1978, Pifblic/Private Ventures 
(P/PV) was sel^^ted to conduct a demons t rat icp pro j ect that 
would test various strategies for the involvement of the 
private sector in the employment and training of disadvan- 
taged youth. This report is part of a series that summa- 
rizes P/PV!s bindings. In this volume, two specific program 
models are described and assessed: 

« * 

• Subsidized Work Experience in tfte Private, Sefctdr 

• Occupational Accessing. 

I. SUBSIDIZED WORK EXPERIENCE tN THE PRIVATE SECTOR 

Traditionally, federal regulations have limited work ex- 
perience programs to placing youth in public and non-public 
agency settings." Supporters of this restriction claim that 
subsidizing private sector work experL-efice would result in 
worker displacement and give unfair compet it ive • advantages 
to certain ' prof i t-making firms. Opponents have claimed that 
the prohibition . against private sector +/ork exper ience de- 
prives youth 'of important opportunities and contact^ for 
future employment. ^Unfortunately, scant empirical evidence 
exists to support or refute, these contentions. In order to 
gain more, insight info, the possible efficacy of subsidized 
work experience in the private sector, the Department ,of 
Labor commissioned P/PV to f un'd ^and research* a pair of 
programs ,^orte in rural Wisconsin and the other .in the San 
Fernando Valley section of Los : - Angeles . To diminish pos- 
sible objections from organized labor, only small firms wittj 
non-unioni;zed work forces were . involved . The Department of 
Labor was especially iatere^ted in learning how employers 
would respond to thesp pSograims, which featured a powerful 
mix of incentives for them to provide youth- with dp to six 
months of work experience. The incentives included: f 

• fiUll sub~si<3y.of participants 1 salaries., at' the _ ' 
minimum wagef; s * 

v > virtual elimination of red tape sifice the sub- 
sidy was paid directly to the participants by* . ^ / 
tbe -programs; * - 

~X ■ .*■* •' I . 

•<r.^no obligation on an employer's patt to hire, a c < 

yoijth after, trai-ning was completed. 



The San Fernando Valley, progrem, Open Road/New Jobs, was 
operated under the aegis of the Citizen's Policy Center, an 
organization begun in California during 1975 to addtess the 
problems of youth in the areas of employment, education and 
citizen participation . Focusing on out-of- school , • Hispanic 
youths, the program functioned from November 1979 through 
March 1981 and placed 111 youths in work experience set- 
tings. Project Oppor tuni ty , the Wisconsin program, was 
conducted by ADVOCAP, Inc., a non-profit Community Action 
Agency, founded in 1965. The project opened* its doors in 
May 1979. After placing 125 youfhs in fully subsidized * work . 
experiences, Project. Opportunity switched to partial subsi- 
dization in March of 1981. This partial subsidization 
cal led for employers to reimburse the program for 50% of the 
participants' wages earned during the latter half of the* six 
month placement periods Fifty-nine youths were served under 
this revised model , which operated through* March, 1982. 

Resul ts 

The ma j or pol icy questions concerning the use of wage 
subsidies, addressed' in this research, are: 

<? will employers respond to them? 

* are labor market prospects of the youth . 
improved? 

The answer to the first question appfea^s to be yes. 
Program staff were able to place youth quickly "(-within two 
to four weeks) in well designed work experience settings. 
Data from almost two hundred participating employers show 
that they were especially pleased with the programs 5 hand- 
ling of paperwork, with ths wage subsidy,; and with the op- 
portunity to teach young people. their trade. Employer par- 
ticipation did not diminish when firms were required to pay 
hal f of the youths r wages during the second three months of 
the placement. The wage subsidy was positively viewed by 
employers as reducing training costs and risks. 

Anecdotal evidence indicates that the subsidy (along 
with the program staff's close involvement) "bought toler- 
ance" in the form of employers* going to extra lengths in 
solving problems such as the tardiness' and absenteeism that 
often occur wi th disadvantaged youth. Almost half the em- 
ployers believed that the program youths performed below the 
level of their typical entry employee; however, this did not 
appear to decrease employers' inclination to participate in 
employment and training programs. Forty percent reported 
that they were more willing tp become involved while about 
15 percent reported the opposite. Finally, before 

participation in these programs, most firms u ad never hired 



youths from employment and* training programs. TMs 
indicates that these program, models tap a new and viable 
source of private sector training: small businesses. ^ 

But, do the programs improve the subsequent earnings of 
youth? Available data are negative, but limited to a single 
program, Project Opportunity Phase I, which' appears to have 
been generally less . effective than either Open Road/New Jobs 
or Phase II of Project Opportunity, in which employers 
contributed a portion of the trainee stipends. On other 
indicators, specifically costs and status at termination, 
the programs fared better . > Job placement rates at termi- 
nation were higher .than . those of comparable youth efforts. 
While costs were high in the start-up year of Project Oppor- 
tunity, Phase II cost figures approached those of national 
OJT and formula- funded work experience programs . Nonfethe- 
less, in the one program where impact was measured J the 
results were not positive. j 

In summary, the viability of the subsidy mechan ism and 
the response of small businesses were encouraging. However, 
more broadly-based research is required to determine whether* 
and how this mechanism can contribute to the JLoritg ..term en^- 
ployability of disadvantaged youth. 

II. OCCUPATIONAL ACCESSING 

This strategy sought- to link skills training for disad- 
vantaged youth with high demand occupations in local labor 
markets. Theoretically, it was posited that youth could 
make quantum leaps into new careers if the program supplied' 
trained graduates in either of the following areas: 

0 in occupations characterized by severe x ski lis 
^ shortages; or, 

• in nascent industries that" promised job oppor- 
tunity but had yet to develop % r igorous employee 
Unduiction criteria and procedures. 

s 

Two\programs were initiated by P/PV in late 1979 to test 
whether 1 planned occupational * strategies that address local 
employment needs would work for youth. The Machine Trades 
Training^ Program £ f or Youth (MTTPY) operated in Cleveland , 
Ohio under the auspices of Cuyahoga Community College. The 
program was designed to train disadvanLaged*, youths for the- 
machine trades, a, field that was experiencing acute problems, 
in attracting a sufficient number of " skilled workers. in a 
world center for the machine * tool industry^, Cleveland em- 
ployers were concerned about the diminishing' availability of 
skilled labor and an aging workforce. MTTPY, which offered 



training, work experience, OJT) , sought * to tt ain 126 youths 
during its first year of operation.^ . ; - t 

4> In October, 1979, Career Pathways in Energy Conservation 
, (CPEC) was b v egun. The program was undertaken because in 
Boston, and "indeed across the country, .the energy conser- 
vation field was 'expanding quickly.. Further, many believed 
that imminent legislation would requi re "regulated utilities 
to offer their customers energy audits, thus creating a sud- 
den demand .for skilled workers. Local studies forecast a 
high demand for trained workers in the energy field. 

The prog ram> under the management of the Technical De- 
velopment Corporation, sought to train and - place 100 aut-of-. 

\school, disadvantaged youths in entry level positions with 
energy related employers. Youths were to.be equally recrui- 

- ted from Boston and the "Border Region" between New Hamp- 
shire and Massachusetts. Like MTTPY, CPEC developed an ex- 
tensive training Sequence that embodied cognitive and ap- 
plied. classroom' training, wo.rk experience, OJT and job 
placement assistance. 

Results 

What was learned" from CPEC makes a cautionary tale. The 
program was a failure, ^plain and simple. Th ee factors may 
have contributed to CPEC's low rate in placing youth in gobs 
(22%) and exorbitant Qosts ($42,118 per job placement in- 
cluding youth stipend costs). Fir^t, the program design 
was faulty on a M^mljer of- counts m y 4 Tb^many interdependent 
actors and agencies v performed * diverse rtmctions . The 'cur- 
riculum, Which led "o*ff; w ; ith ap eight we^k— Classroom experi- 
ence, may have discouraged ycPuth and contributed to a high 
drop-out rate. Training staff had, trouble dealing- with the 
particular needs of the trainee population. Close ties to 
employers were net maintained . The program's focus was upon 
an emerging and volatile industry where occupational projec- 
tions are inherently diffiVult.. Recession coupled with the 
defeat 1 ' of the .National Energy Policy and Conservation Act 
vastly reduced the demand for workers in the energy field. 
Finally, the Department of Labor instructed the program to 
avoid training in areas- in which private sector firms were 
explicitly involved.. This jnade it difficult for program 
planneris to develop a specialized curriculum. 

In the case of MTTPY , the results were more promising. 
Despite,, the sudden' downturn 4n an economy that* left numerous 
veteran machinists out of work, the termination and cost 
data were impressive. MTTPY positively terminated 58 per- 
cent (n=63) of its participants with 41 percent (n=45) 
securing unsubsidi?jsd jobs. ..The rates were. clearly superior 
to the mean for national skills training programs for youth. 
MTTPY* s cost per positive termination was less than most 
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other comparable programs. Because the Department; of Labor 
opted not to support longitudinal research on these pro- 
grams, the post-program impact of MTTPY is not known. How- 
ever^ its operational feasibility appears strong and rests 
upon several solid programming principles: 

• 'in-depth diagnosis and screening of youth; 

* r 

• continuous private sector involvement; 

• staffing of the program with retired machinists, 
who had far-flung informal job networks; 

• concreteness and output orientation of the 
curriculum . 

- .Several pol icy impl i cat ions flow from these £ indings . 
First, it appears that carefully designed skills training 
programs can work for youth, although the absence of longi- 
tudinal data precludes -definite answers on long range em- 
ployability effects . Second, MTTPY ' s occupational' area , an 
established industry, was somewhat less vulnerable to eco- 
nomic fluctuation compared, with CPEC 1 s emergent energy 
field. Finally, MTTPY' s apparent success hinged upon a well 
thought-out and well deliv ered service sequence. 
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This report is one- of a series issued by Public/Private 
Ventures as part of a multi-site demonstration project begun 
in 1978 with the support of the U.S. Department of Labor 
(DOL) . The project has developed and assessed a .number of 
approaches to private sector participation tfn employment and 
training programs for 16 to 21 year old, economically disad- 
vantaged, oUt-of-school youth. OverwKfelmingly these are 
poor, minority, high school drop-outs wixh scant work exper- 
ience and few skills. Stich young persons experience severe 
difficulty in securing jobs; and, as they grow older, typi- 
cally do not catch up' with the . remainder of society % in terms 
of earnings. While the teenage population is shrinking, it 
is not expected that the employment problems of " disadvan- 
taged youth will teadily disappear since the minority share 
of the youth population is increasing along with urban high 
school drop-out rates (cf • Congressional Budget Office, 
1979).. ( 

Widespread agreement about the chronic needs of this 
group is tempered by equally widespread uncertainty about 
what to do. This report addresses two strategies: 

• subsidized work experience 1 in the private sector 
which tries to^ foster good work habits leading 
to employmgnt; and, 

• occupational access ing which strives to link 
youth with jobs in rapidly growing , industries or 
established ones experiencing skills shortages. - — 

Subsidized Work Experience in the Pr ivate"' Sector 

Current CETA regulations (Section 676. 25-4 (a) (1)) 
explicitly forbid wqrk experience programs in the private 
sector. p The/ro6ts of this prohibition trace back twenty 
years to the Manpower Development and Training Act of 1962. 
Resistance was led by organized labor who feared that 100% 
wage subsidization would result in t*ie d isplacement of union 
workers. As one employment and training ^vete^in put it:« 
"The labor movement believed that subsidized work .experience 
would amount to replacing parents with their children." 
Congress ' has traditionally echoed this view and also has 
shown concern that subsidized work experience programs might 
give unfair competitive advantage to certain pror it-making 
firms over others. Since their - incept ion under the Economic 
Opportunity Act of 1^64, work experience programs have with 
few exceptions been limited to public and non-profit employ- 
ers . 



• However, the strategy of direct monetary incentives to 
private sector employers- for hiring disadvantaged youth 
possesses a lingering appeal and periodically conies to the 
fore. • For example, the National Commission for Employment 
Policy (NCEP) in its 1979 Report to the President and } Con- 
gress asserte'd: % ■ * 3 

•u 

In particular the current prohibition against 
private sector work experience under CETA is de- 
priving youth of opportunities to learn more 
readily ..transferable skills., to be exposed to a 
wider variety of work settings, and , to acquire 
valuable contacts and "references for future em- 
ployment. In addition, such experiences could 
help to break down the resistance of many employ- 
ers to hiring- youth from disadvantaged minority 
communities. Accordingly the Commission recom- 
mends that: 

Short-term subsidized work experience in 
the pr i-vate sector should be/ permitted 
under CETA with safeguards that emplov^ ;s 
do not misuse the program and that the 
youth are provided 'with a< ^carefully 
Structured and supervised learning 
experience or training opportunity (p. 
21) . 

Currently, most legislative proposals for revising the 
nationVs employment and training system call for limited, 
subsidized work experience in the private sector. However, 
there 'is scant, empirical ^evidence to support or refute the 
efficacy of 'this approach. With special permission from the 
Department of Labor, P/PV designed, funded, and researched 
two demonstration programs that featured a powerful mix of 
employer incentives for providing youth with up to six 
months pf work experience in private sector firms. In these 
two ' programs, youth salaries were fully subsidized at the 
minimum wage; red tape was virtually eliminated; small 
employers wifh non-unionized work forces 'Were targeted for 
participation;' and employers were not requi r,ed to make any 
commitment to hire youth after the subs id i zed training 
period. 

One of the programs operated in rural Wisconsin, the 
ather i*n the San Fernando Valley areia of 'Los Angeles. In 
tfrms of scale', each was relatively small, maintaining a 
.six-person staff a^d placing 100 to 120. CETA eligible out- 
6f-school youth irf\ work experience positions annually. 
Yearly costs not canting research expenditures were about 
$325,000 per -program. Youth enrollment began in^ Wisconsin 
during- May of 1979 with San Fernando following five months 




la'ter* After operating for slightly more than one year the 
California program closed its doors, unable to cohv^rt to a 
local funding base* The Wisconsin program on the other. -hand 
altered its model to test a reduced subsidy level and,- sup- 
ported mostly by_ national . DOL demonstration dollars , pro- 
vided services through early 1982. This report evaluates 
beth versions of the Wisconsin model as .well as the Cali- 
fornia one. , 

Occupational Accessing • 

V 

Skills training programs, both classroom and on-the-job, 
have received continued and substantial cfovernnfent support 
since the early 1960's. The general conclusion about this^ 
activity is heartening: skills training has a significant 
and positive, impact on the earnings of enrollees (NCEP, op 
cit.). However, little research has been performed to 
determine how applicable skills training is to a younger 
population. Some theorize that youth may. not be ready 'for 
intensive special i zed training until they "settled down • " 
Others view the youth labor pool as a viable resource to tap 
when ^kill shortages or emerging occupations create high 
demands for workers. In order to learn more about training 
youth for selected * skilled occupations , P/PV funded, and 
researched two programs, one in Boston and one in Cleveland/ 

In Boston , .market analyses conducted in 1978^ or ecasted 
energy conservation as a rapidly expanding and * lucrative 
field with job opportunities for* young rWorkers,\especially 
as "para-engineers . " In this capacity, youth would leapn to 
inspect heating and production equipment and formulate steps 
to increase energy ' efficiency (a 'labor intensive alternative 
to capital . investment for office buildings, hospitals, and 
factories).' A local non-profit firm with experience in 
energy conservation was chosen to plan and conduct a model 
program to ^rain and place youth in energy-related jobs. 

In Cleveland , an aging workforce populated the machinist 
trade and there were insufficient channels for inducting new 
workers. 0 Shortage! of skilled machinists caused .concern 
among many local grc>ups." In particular , small shops were 
seen .as having difficulty in retaining qual if ied workers . 
It was thought' that small establishments often hired and 
trained machinists only to have them move on to larger 
corporations with superior wage structures and ^benefit 
packages . Under P/PV 1 s aegis , a machine trades training, 
progra'm was develo/ped to train and place out-of-school 
disadvantaged youth. ' u 

Both the Boston and Cleveland programs featured a pro- 
gressioa of training phases: orientation, classroom in- 
struction,, work experience, and CEffc/OJT contracts. Both 



sought to train' 100 to 150. youth per annum at a cost of 
about $700,000 per program. Both enrolled' their first youth 
in October 1979 and ran for about one year. 

Origins o f the Study 

" A $ 

Early in 1978, the. newly, formed Office of Youth Pro- 
grams, within the U.S. Department of Labor, and P/PV began 
to lay the groundwork .for this study. The central goal was 
to test ahd evaluate innovative methods of career induction 
for 'economically disadvantaged youth*. Dur ing_tjie plartning 
stage, ideas ranged f rom v job , restr uctur ing^to job creation 
via economic development .* Prog ram implementation a was de- 
layedN as DOL anfl p/PV^ war ked -toward consensus on specific 
strategies to be testecfT Changes occurred even after pro- 
grams had been formally selected' and several local program 
operators "found thi s lengthy .process politically** embar- 
rassing particularly when they had advertised the programs 
and recruited employers and Advisory Boards" (P/PV, 1980 
p. 51) . In spite of planning problems and delays, all. four 
original candidate programs were eventually funded and. by 
the end of 1979 were servicing youth (cf. P/PV's earlier 
report, New Career Pathways , May 1980 for a detailed des- 
cription of start-up). - 

Concomitant with proposal review and contract negotia- 
tions, P/PV refined the research design which emphasized 
fiv^ basic questions: t \ 

• How do the programs operate? 

* • Does program involvement reinforce^or reduce 
private sector - employers 1 willingness to hire 
n youth and to accept government-funded trainees? 

• What other effects do the programs have upon 
employers? 

• Do the programs enhance the employabil i ty and 
earnings of youth? , 

• Are the programs cost-effective? 

These five questions were used as guideposts in organiz- 
ing the subsequent chapters of this report . 

Organization and Scope of the Report 

As noted, the programs cluster into two distinct inter- 
ventions* Subsidized Work Experience in the Private Sector 
and Occupational Accessing. For clarity, this report has 
been ; - divided in two parts. Pa-rt I addresses the Subsidized 
Work Experience Programs, and Part II the Occupational 
Accessing Programs. To the degree possible^ the same ' topic 
sequence' was followed in each part. 
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As Figure I depicts, we begin both parts with a descrip- 
tion of \the program models. First, th^e models are described 
in the ideal, "how they were meant r to work Next , a quali- 
tative evaluation describes how each prograih really worked 
in its day-to-day operations and discusses t#e demographic 
make-up of the participants. This qualitative description 
serves several ends. A grasp of the processes and problems 
adds interpretive insight, to the numerical findings; 0 helps 
isolate particularly noteworthy features; % and provides use- 
ful hints should- similar programs be replicated in ne.w 
settings. Information for the qualitative arfalysis was col- 
lected by P/PV .evajuators 1 observing, the programs, inter- 
viewing staff and other key persons, and 'reviewing written, 
program documents . , > 

* » , v 

.* After describing each program, a brief analysis of the 
part ici pa ting youths ■ status at the ^t ime when they completed 
the program is presented. Data for this analysis were 
collected on 4 standardized' fo*rms designed by'P/PV and used by. 
ail of the programs. The type of termination, that the youth 
experience is one important outcome of* employment and train- 
ing programs,, and analysis of termination data provides 
^useful information oh such factors as: 

■ fo 
• the effect ivenes of programs ^in 'providing . imme- 
diate employment for youth upon termination; 
and , rK * 

the degree of wastage" of resources a$ reflected ' * 
by nan-positive terminations (cf. Sawhney et al, 
1978).. 

> Unfortunately, as Figure I indicates, -we do not analyze 
the post-program status of youth in the Occupational Access- 
ing strategy. The -Department of Labor 1 s . Of f ice of Youth 
Programs, due to Msc^l 'constraints and other factors, 
specif ied* that follow-up of participants no.t be undertaken 
in these programs. Admittedly 'the absence of such longitu- 
dinal data stymies- an assessment of -the impact that the 
Boston and Cleveland pro j.ects . might have had on the post- 
program labor' market status of participants. A^ related 
situation characterized the California subsidized ^work ^ex- 
perience program. In this instance, the Department of Labor 
instructed P/PV to conduct- an eight-month; post-program 
follow-up with 5 participants, but not* with comparison m sub- 
jects. Our analysis of post-program impact was. therefore 
restricted to Project Opportunity,* the subsidized work 
experience program in rural Wisconsin. Given, these con- 
straints,' the . reader is strongly cautioned to avoid j udg- 
.ments regarding the longer-term impacts of the programs 
reported in this study, with the exception of the original 
Pro j ect Opportunity program . 



. „ Figure I: Sequence of Report Sections 

Part I ; ^ Subsidized Work Experience' Part ^11: Qccupational D Accessing 



The Models in Theory 



The- Models in Action 



- w 



Youth Status at Termination 



■v 



Follow-Up Results : Program Youth 



V 



Impact Original Wisconsin 
Program on Youth Participants 



Cost Analysis 



v. 



Employer 


Analysis *■ 


. \ 


/ ■ . 



Summary and Recommendations 



The Models in Theory 



& ■ 



The Models in Action 



V 



Youth Status at Termination 



Y ' 



Cost Analysis 



Y 



Summary and Recommendations 



2 



ERLC 



Our u employer analysis is also ^restricted to ^ the Sub- 
sidized Wo i^k" Expedience strategy. Substantial baseline 
information was. solicited from several hundred firms' which 
accepted youth into traineeships • In^ addition, a^number o^f 
in-depth .interviews were conducted with) several employers at 
each program site . Fi nailer follow-up phone surveys were 
pejTfcormed with employers several months after they had 
accepted , a -*youth into training. Thes£ data permit -us to de- 
scribe what typ.es of employers participated and assess how 
the; programs influenced employer attitudes and hiring prac- 
tices . 



In order to gauge each program ■ s cos t- ef feet iveness , we 
computed several indicators such as cost per participant and 
cost per unsubsidized job at termination.^ A straightforward 
comparison of these unit costs with thpse available from" 
similar programs provides insight into how ' the study pro- 
grams ^measure up to ^-established ^ program efforts. However," 
the lack of post-proo/ani information ori the labor market 
status of youth precHided analyses of a niore sophisticated 
nature, such as benefit-cost analysis. " ( ° / 

Finally, each part of our study concludes with a summary 
of key findings useful to^pplicy makers and planners. 
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. f \ ft N PART I 

SUBSIDISED WORK EXPERIENCE IN THE PRIVATE SECTOR 

-With special permission from the U.S. Department of 
Labor , two demonstration programs were begun in 1979: 

• ?rojecJb Opportunity, which was" operated by 
Wisconsin-basec}* ADVOCAP, Inc., a non-profit 
Community Action Agency, founded in 1965 sub- , 
sequent to the Economic Opportunity Act; and, 

• Open Road/New Jobs, which was operated under the 
Citizen's Policy Center, an organization begun 
in California during 1975 to address yoi£** 
problems in the fields of employment, education, 
and citizen participation. 

Both organizations drew upon prior endeavors in design- 
ing their demonstration models. The general concept for the 
Open Rtfad/New Jobs program evolved from their 1975 demon- 
stration whiclv was jointly supported by state CETA^ discre- 
tionary funds and 'a federal grant from the . Community . Ser- 
vices Administration. This- earlier demonstration placed 
youth in both public and private .sector entry le<vel posi- 
tions ^nd offered minimum ..wage stipends for, a six month 
period. In 1977, the DOL Office ,of Youth Programs identi- 
fied this project as "art exempl'ary . youth employment project" 
and N during 1978 plans were made to concert it to a purely 
private sedtor. work exper ience 'effort . 

The' Project Opportunity model examined here developed 
from a program that ADVOCAP had been conducting since the 
mid-1970 , s ? . Private funding from the Ralston-Pur ina Company 
had supported a small summer jobs program which placed youth 
in short-term private sector positions, and offered them .mod- 
est draining stipends. Shortly after the passage of nation- 
al youth ^employment legislation in 1977, ADVOCAP requested 
state discretionary monies to expand the project to a full- 
blown, year-round one. I Based largely on local prime sponsor 
objections, it. was determined that experimentation ;was not 
permissible because ifr. violated regulations restricting work^ 
experience .subsidies to public and non-profit firms. - ADVO- 
CAP countered by successfully seeking national demonstration 
funds. 

* < * 
ADVOCAP 1 s Er]p j ect Opportunity inducted its first youth 
in May, 1979. and operated through February 1981. At that 
time,- staff revised the model by requiring employers to pay 
a, portion of the training- stipends. This revised versibn of 
the program was supported by Department of Labor demonstra- 
tion funds from March 1981 through -March 1982. Open Road/ 
New Jobs enrolled its first youth attiring November 1979 and 




ran for sixteen monthef^tlfaough February 198L. Our research 
covers the entire o^pe^at-fng period for, each program. In 
this part of tfte report, we discuss the design of each pror 
gram model (Chapter II) and describe each program during its 
actual operation (Chapter III) . Special attention is given 
to problem areas that were not anticipated by the program 
architects. Chapter IV 'analyzes participants 1, status .at 
termination. In addition to examining the . types of "termi- 
nation experienced by -almost- 300 youths, in these program^ 
results f^pin multivariate analyses are* recounted in an at-* 
tempt to ildeilpify the association of selected youth char-, 
acteristics with termination stpatps and earnings. As n^ted" 
earlier, eight-month post*-,termination interviews were con>- 
ducted with participants in both Open Road/New Jobs and Pro- 
ject Opportunity. Chapter V analyzes data from these inter- 
views to investigate whether* selected yout,h. and program 
characteristics predict participants ' success on the job 
market. This analysis is followed in Chapter VI by an im- 
pact study which* measures employment and earnings differ-' 
ences between Pro j ect Opportuni ty youth and a comparison 
group * o f youth, who were interviewed during similar timfte 
periods. The cost-effectiveness of these programs is dis- 
cussed in Chapter VII by -means of a comparison with existing 
training programs. Chapter VIII focuses on employers who 
trained youth, . A "profile^ of participating" businesses is 
presented along withj employers 1 perceptions of the profgr'ams, 
the youth, and the impacts of program participation upon 
their hiring practices. Findings are summarized and recom- 
mendations are presented in Chapter- IX, the final chapter of 
this part of the report. 



' 9 CHAPTER II: THE MQDELS IN THEORY- ; 

' in many y/ays, the, Project Opportunity* and Open Road/New 
Jobs programs- ciosely resembled one another. Each featured 
a forceful cluster of incentives designed to induce small 
employers \ to; enlist economically disadvantaged/ oujt^of- 
schooX youth . as* trainees. However', the ^programs differed in 
several * respects . This chapter describes the programs \ 
designs' in order to provide* the reader with a picture^ of the 
main components ' df Project. Opportunity . and Open Road/New 
Jobs. v v 7 " / • > . * 

Project Opportunity 9 . 0 

Youth arrived at Project Opportunity's doorstep having 
been referred from the local. Job Service (such . youtH had 
.already been^ CETA certified), 'or from community agencies; or 
by other youth. . ^One of three job developers explained the 
program "and, if needed, directed the' candidate to the Job 
'Service for formal scteening and certification. Certified 
youth returned to meet with the job developer ^ in several 
one-to-one sessions where the job developer explored ^ career 
interests, informally assessed* woi;k aptitudes and attitudes, 
and investigated the ne'ed ;for support services. Youths .who 
manifested severe-' emotional, behavioral, arxd/br physical 
disorders 'were screened out. Such youths were referred for 
special treatment and invited back after their problems had 
been resolved. The typical youth , however, was able to work 
successfully with Project Opportunity's job developer in des- 
tining occupational preferences. The job devqloper then be- 
gan to identify businesses in the youth's interest area for 
a suitable placement. During the initial meeting with a 
prospective employer. Project Opportunity job developers ac- 
cented the theme of low risk, emphasizing to the employer 
the youth's special interest in a particular occupation as 
well as 'the following program attractions: 

100 percent of youth' s salary (minimum wage) 
paid by the program directly to the youth ; 

full insurance liability carried by the program ; 

bonding, if necessary, provided by the program ; 

the chance to interview and choose the youth; 

ongoing contact with the youth by the job devel- 
oper; and 

ng required commitment^ to hire the youth after 
the sixmonth training per tod^. 
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Red tape and risk were minimal. The employer, in addit- 
ion to providing "a sound training experience," was required 
only to transmit, a weekly time sheet verifying the number of 
hours worked by the youth so that the program could pay, the 
youth • Conditions of "a sound training experience" included 
each employer's designing and following a formal training 
plan which mapped a progression of job tasks arid designated 
a supervisor who would serve. as a mentor for the youth. Em- 
ployers had the option to formalize the pact in a three-way 
agreement co-signed by the youth, the employer, and the job 
developer . 

After placement, the job developer maintained close 
contact with both the youth and the employer in ord^r to 
gauge progress and intervene quickly should problems arise* 
As youth eased into their jobs, they were urged to complete 
a- General Educational Development (GED)^ program if ,they did 
not have a high school diploma. If the need for specialized 
support services became apparent , the job developer would 
function as a counselor for the youth. Toward the midpoint 
of the six month work experience, the job developer turned 
attention to the youth 1 s post-training employment . Custom- 
arily the employer would* be asked, if the youth might be tak- 
en on as a regular employee. If the chances for this were 
not good, the job developer began to ferret out alternative 
employment or, in some cases, to line up additional training 
or education for the youth to pursue upon termination from 
the program. 

After operating for over a year and a half, Project Op- 
portunity converted- to its "Phase II" program model in March 
of 1981. This model was virtually a replica of the ane just 
described except for a prominent variation in the stipend. 
Instead of providing participants' an "up to six months" 100 
percent wage subsidy, equivalent to the minimum wage, the 
following modi fication was adopted: 

[The program pays] 100% of the minimum wage 
for the first three months, after which the program 
contributes 50% of the minimum wage and fringe 
benefits and the employer contributes 50% of the 
minimum wage for .the remaining three months of 
training (ADVOCAP- Proposal , 1980, p. 2). 

Fiscally, this represented a move toward^program self- 
sufficiency because the public funds required for^wage sub- 
sidies would be reduced from 100 percent to 75 percent^ if 
each youth stayed the full six months. Above and beyond 
fiscal advantages, the program planners believed that the 
employer "buyin" would increase both employer interest in 
the training, and the rate of direct hiring at the end of the 
training period; *, Procedurally, the program continued to pay 
youth their full minimum wage- amount but after month three 
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participating employers were invoiced for 50 percent of 
monthly wages and fringe benefits. 

\ 

Open Road/New Jobs ^ * N -_^ 

Open Road/New Jobs parallels Pro ject Opportunity with 
three notable except ions . First, ifistead of continous 
intake and placement, youth were enrolled in two waves or 
cycles per year, occurring six months- apart • Each wave was 
to include 60 youth. Youth recruitment began a month or so 
before a cycle 1 s beginning . Second , Open Road/New .Jobs 
featured a formal pre-employment training component . Each 
cycle commenced with a two-week long workshop. New parti- 
cipants were divided into subgroups of twenty and ea^h sub- 
group was expected to complete an identical training se- 
quence. . A formal curriculum accented job readiness" train- 
ing , values clarification', and -career education,. Training 
was primarily conducted by the two-person administrative 
staff with time built-in for youth to become acquainted with 
their job developers. It was up to the three job developers 
to find each of the 20 youth in their own caseload a work 
experience placement by the end of the workshop period. The 
third difference from' Project Opportunity was that Open 
Road/New Jobs placements were to be drawn from a pre-exists 
ir\q job bank of employers who had agreed to train progi 
y6uth. 
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In terms of scale,, each program had a staff of six 
including a director, three job developers, an assistant who 
handled research duties, and a secretary. % 




CHAPTER III; __The Models in Action 



Thi s section examines the programs 1 clientele, services, 
op^t^tia nS » It asks questions such as: What happens in 
fch^ pr°9ram£? What types of youth enroll? How do youth 
J?t^gre£. s thrr° u 9h the programs? What are the critical events 
^H#t influence youths and employers? What program features 
m^st rrePli cable and , c conversely , most problematic? 
#h^w^r£ can help in* understanding "how* 1 and "how . well" the 
Pttpgtaffls - pe r ^Ormed and, what, components were especially 
tfbtzewo^thy . / * 

Inf°tmati°n used in this chapter comes from two sources,: 
^li^nt i t^t iv^ d^ta drawn from a uniform data collect ion sys- 
t^tfi an^ qu^l itati ve information from ^on-si te observat iojvs 
#h<£ interviews with st^fx f employers, and youth, The chap- 

is °tgartized according to sequential program phases with 
# ^peci^l section 'devoted to youth characteristics, 

intake 



'■ « / 
Op^n Ro^d/l^ew Jobs and Project Opportunity exempl i fy how 
#H 3s^°Utnen t of factors can impede recruitment. Their 
#*£>er i e t*ces Point Up not only the need for more careful 
^l^nning bufc.^or structural improvements in the CETA screen- 
and certification- system. • , 

In term£. of planning deficiencies f Open Road/New jobs 
PtAnptlY t${\ into difficulties, . plans called for two six- 
i*o<ith cy c x'e^r ^ach .serving six'ty youth. This- resulted in an 
^^edi^te overload as staff f working with virtually no lead 
^it^^f w ^re ^^ c ed with the task of developing a bank of over 
^i^ty j°b p^^ c ements f recruiting and screening sixty youth, 
#t\^3 ir°^ing °Ut the program's fine points — within a two 
rt^nth, Psritfd during November and December, 1979. It is 
tt^dly Surprising that, in spite of effective working rela- 
tionships with referral donrfees, Open Road/New Jobs enrolled 
<3t\ 1/ fchir ty-ni ne (39 ) xoujbh f°r its first cycle f a 3 3% 
£\\ait£ a ^lJ By Cycle H^tHis problem was resolved and the 
^ o^r^ sUrrP a ^sed its recruitment goal. However, staff 
^o^Klo ac 3s continued to ebb and flow radically because , co- 
.H^ideflt with the Spring 1980 Cycle II recruiting period, 
'^taff' yere seeking' to place Cycle I graduates k in unsubsi- 
&\ zed j^bSv *n hindsight, the cycle approach was less than 
££timal ana °pen Road/New Jobs staff agreed that Project 
^^ott ut iity ' s con-tinuous enrollment plan w'as superior. 

Pr°3er:t Opportunity also experienced recruiting di f f i- 
c Ultie s f t>u£ these appeared to be more exogenous and related 
loc~ k \ economic cycles, .project Opportunity 1 s geographic 
"£^rvic e are# Encompassed Winnebago and Fond, du Lac counties 
^eluding tP e city of Fond du Lac located at the confluence 
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of the Fox River and Lake Winnebago. The city,- a major 
center for canning peas * and sweet corn, is the gateway to 
the Fo^x- River Valley (known to most as the Valley of the 
Jolly Green Giant) . During, summer harvest, seasonal }(?bs 
abound and .temporary wprkers in 1979 we're earning over. $6.00 
N an hour plus overtime in the canneries. Spring and summer 
^unemployment rates were estimated at between 3% and 4% by 
the local Chamber of Commerce. Project Opportunity opened 
its doors in May 1979 and recruiting instantly lagged. The 
new program, with its offer of minimum wage youth stipends, 
had a difficult time competing with the more lucrative,, 
albeit temporary, jobs in the canneries and on the farms . 
Intake during the^ .summer fell 50% below performance pro- 
jections s However , in the f all , recruitment improved and 
after October 1979, monthly projections were met. Even 
during subsequent summers, the program was able bo achieve 
recruiting target levels largely due to a better developed 
referral system. 

Start-up overloads and seasonal fluctuations can be 
rectified in the planning process. However, a major problem 
lay close to the heart. of .the CETA system in its screening 
component. The U.S. Department of 'Labor has stated that: 

Identifying client needs is an essential compo- 
nent of good programs. Intake and assessment 
are activities where this is accomplished. For 
a program to be successful : it must ... be able 
to identify those clients who can best use its 
services (Employment^ and Training Administra- 
tion, 1978, p.l). ~~" — 

bpen Road/New Jobs and Project Opportunity both con- 
tracted with, local Job Service offices to screen,- certify, 
and refer youth. Both programs noted problems with the 
client screening process. Interestingly, the problems 
represent obverse sides of the same coin. Open Road/New 
. Jobs s,taff, while maintaining a close, cooperative, and 
quick-to-act relationship with the Job Service, were less 
than pleased with the caliber of screening. In fact, Open 
Road/New Jobs job developers tagged poor screening on -the 
part'of the Job Service as the primary operational problem. 
Staffs claimed that disproportionate number^ of problematic 
youth, especially drug abusers, slipped through the screen- 
ing net -only to fail abruptly when faced with program att?en- 
d^nce requirements. Conversely, in the Wisconsin .program; 
the Job Service came under criticism from Project > Oppor- 
tunity staff for taking so much time in screening youth, 
(three to four weeks) that many youth got fed up and with- 
drew. 

A conundrum Is apparent. Hasty screening may not * de n- 
tify individual problems and can result in a negative, dead- 



end program experience. Rigorous ^n<3 lengthy assessment 
frustrates youths' desires to get job£ quickly; some youths, 
with possibly sound potential, drop out of the pro c ^ss. A 
final problem suggested by Project Opportunity staff (and by 
Qther P/PV demffnsj/rat ion program - personnel) has to do with 
the financial structure of central intake and screening 
units such as the Job Service. Commonly these units have 
several client programs who pay them a fixed fee for youth 
-certification,, assessment, and referral* It has been argued 
that established programs with proven longevity are dealt 
better qualified youth in higher numbers than demonstration 
projects which by design often have shorter v life expectan- 
cies. This could result in demonstrations being : assigned 
candidates who are less job ready. 

In; raw numbers, Open Road exceeded their fifteen month 
(August 1979 to November 1980) target of 100 ; y<yu£hs by 20. 1 
Project Opportunity fell a dozen -youths short Q f it§ first 
year performance objective, enlisting 108 youths* however 
this seems attributable to planning problems encountered *n" 
starting-up the program at the beginning of the Summer of 
1979. 

Participant Characteristics 

Participants in the original Project Opportunity demon- 
stration (PO I) and the revised version (PO H) embodied 
certain demographic characteristics oi their servi c e area. 
Project Opportunity's service area was largely r urai with 
manufacturing concentrated in four Middle-sized cities: 
Fond du Lac, Oshkosh, Neenah, and MenaSha. Practically ail 
residents are white with the 1977 median family inc oin e on 
the order of $10,200. Unemployment during this time hovered 
between -6 and 7 percent. Although almost nineteenths Q f the 
land area is devoted to farming, better than a third. Q f the 
jobs were in manufacturing with many (44%) of th^s© being 
union-ized (Area Economic Authority, J977) . 

Youth in both phases of (Pro j ec't Opportunity w^ r e over- 
whelmingly white (see Table 1) . They scored exceptionally 
well in reading ability compared to other CETA program 
populations in spite of the fact that over half w e re high 
school dropouts. In terms of age, Project Opportunity youth 
tended toward the upper end of the 16 t 0 21 year. old eligi- 
bility interval, .especially the Phase II participapts w ho on 
the average were 19.1 years old - a full year older than 
Open Road/New Jobs youths and almost half a year.ol^er than 
their Phase I colleagues. Although 64 percent of 'the Pro- 
ject Opportunity youths lived "on their own 11 (not with their 
families), comparatively few (12%) had dependents. AH pro- 
ject Opportunity youths were out, of school at the time of 
intake, but a sizeable portion (40%) Had graduated from high* 
school with an additional 6% reporting Some college °r other 
post-high school educational experience. Seven of ten 
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Table l 



Distribution o? P articipant Cha r acteristxcs at Intake 

£>0 I and II / OR 



Characteristics 



PO I 



n 



% 



(n=l25) 



PO II 



% 



(n=59) 



OR 



n 



(n=lll) 



1. Age 



1 6 anH undpr 


4 


3%' 


1 


2% 


22 




20% . 


17 V ' 


23 


18% 


7 


12% 


21 




19% 


18 


38 


30% 


10 


17% • 


23 




21% 


. 19 


23 


18% 


16 


27% 






iy % 


20 . 


26 


21% 


15 


25% 


13 




12% 


21 


11 < 


9% 


10 


17% 


11 




10% 


Mean 


18 


. 3 


19 


• 1 


18. 


X 


S.D. « 


1 

* 


.3 


1 


.3 . 




1. 


6 


2. Sex, 




> 












Male 


51 


41% 


39 


66% 


79 




71% 


Female 


. 74 








32 




29% 


3. Ethnic Group 








( 








White 


119 


95% 


57 


97% 


31 




28% 


Black 


0 


0% 


0 


0% 


- 14 




13% 


Hispanic. 


3 


2% 


0 


' 0% 


65 




59% 


Other 


3 ' 


2% 


2 


3% 


0 




0% 


4 . Family Status 












t 




Head of Household 








12% 


10 






Parent 


13 


10% 


7 




. 9% 


, Member °f Family 


45 


36% 


26 


44% 


75 




6 8% 


family of one »- 


67 


54% 


26 


44% 


26 




23% 


Mote: Due to rounding £>ercents 


do not 


in all 


cases 


sum 


to 


100. 



r 
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Table 1 (cont. ) 



. Distribution of Participant Characteristics Intake 
" PO I and II, OR 







PO 


I 


PO 


II 




OR 


Characteristics 


• n 


% 


n 


% 


n 


% 






■' "<n= 


125) 


(n 


-59) 


(n=lll) 


5. 


Number* of Dependents 
















Zero 


111 


>89% 


51 


86% 


84 


76% 




1 


9 


7% 


3 


'5% 


23 


21% 




More than 1 


5 


4% 


•5 


9% 


4 


'4% 




Mean 




16 


• 


23 
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v 

V 


S.D. 

Education Grade 
Completed 




50 


1. 

■ 


64 




.70 




Less than 9 


4 


3% 


, 1 ' 


2% 


3 


3% 


1 


9 


15 


12% 


6 


10% . 


18 


16% 




10 


23 


18% 


15 


25% 


21 


• 19% 




11 


27 


22% 


8. 


14% 


44 


40% 




High School/GED 
•i 


46 


37% 


• 28 


47% 


18 


" 16% 




Post-Secondary 


10 


8% 


1 


2% 


7 


6% 



7 . u ABLE Reading Score 
(Grade Level) 

3 - 4.9 6 6% 

5-6.9 1 * 4 4% 

7-8.9 29 27% 

9 70 64% 

Mean ' 8.42 ' 8.41 " v 7.09 

S.D. 1.20 1.45 2;04 

n=109- * ' n=55 n=106 



4 


7% 


20 


19% 


2 


4% 


17 


'16% 


12 


22% 


35 


• 33% 


37 


67% 


34 . 


32% 
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Distribution,. of Participant Characteristics at Intake 

PO I and II, OR 



Characteristics 



PO I 



n % 
(n=l25) 



PO II 



n 



OR 



n %. 
( n=lll) 



(n=59) 



10 



11 



12 



13. 



Ever Enrolled in 
Training Program 
Yes 



No 

Ever Held Full 
or Part-time 

Yes 

No . *» 

Worked During 12 
Months Prior to 
Intakfe* 

Yes 

% ... 
; NO 

Hourly Wage of Last ■ 
Job Ever Held * 

Mean 
S.D. 

Hourly Wage of Last 
Job Within 12 Months * 

Mean 

*S.tf. . 

Hour's Worked per Week 
on Last Job Ever Held* 

» 

Mean 
S.D. 

Hours Worked per Week 



on Last Job Wrthin 12 * 
Months . 

; Mean 
S.D. 



56 
69 



45% 
55% 



83 
42 



66% 
34% 



57 
26 



69% 
31% 



$ 3.26 
$ 1.12 



$3.48 
$ 1.07 



36.7 



9.9. 



38.1 
10.1 



21 
38 



36% 
64% 



43 
16 



73% 
27% 



Not available 
Not available 

$ 3.55 
$ 1.08 

Nqt available 
Not available 



35.6 



8.0 



Not available 
Not available 
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*Data pertains to only youth who held jobs 
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■36 
75 



32% 
68% 



67 
44 



60% 
40% 



51 
15 



77% 
23% 



$ 3.55 
$ 1.34 



$ 3.51 
$ 1.14 



36.0 
7.4 



^36 .0 
7. 5 



1 



Project Opportunity youths had held a job prior to program 
entry. For the -most part pre-program jobs were full-time 
and paid about $3.50 per hour. V 

The data reveal, a systematic difference between Phase I 
and II enrol lees fn Pro j ect Opportunity . Phase II youth 
were older, mostly, male, held more previous jobs for sub- 
stantially higher hourly wages, and' had attained more high 
school degrees. In brief, Phase II youth appear more job 
ready, an observation shared by program staff wi\o felt that 
Phase^II youth were" x>f . a ■ "higher caliber . 11 This- change in 
clientele did not appear to stem from arjy programmatic 
alterations, but rather from worsening economic conditions. 
y Project Opportunity . staff note that local unemployment fates 
had jumped to 13 percent by nearly 1981 when Phase II opera- 
* ^Jiions began.. Increased numbers of youths were out of work, , 
CETA eligible, and willing to accept the minimum wage. 
Staff hypothesize that, as* a result, a "bumping process" 
occurred wherein the Job Service referred more mature candi- 
dates to Project Opportunity, most of whom were males who 
had^pte-vious employment exper i ence . 

✓ 

Open Road/New Jobs yquth did not typi fy the population 
of the San Fernando Valley. ."The Valley," an unincorporated 
area within the Los Angeles city. limits, supports a popula- 
tion of , about 1,650,000 (75% white) within its 235 square 
miles. If the Valley were a city, it .would be~ the sixth 
largest in the Unite£ States. Whereas 17 percent of the 
families in Fond du hd'c County, Wisconsin, earned $15,000 or 
more in 1977, 60 percent of the Valley* families achieved 
this level with the median family income being about. 
$18,000. In the Valley, over 70 percent of . male household 
heads and 55 percent of female heads had some college 
education (San Fernando Valley Regional Chamber of Commerce 
and Visitors Bureau, 1978). However, the Valley included a 
number of low income pockets' which Become more frequent as 
one moves inland from the Pacific Ocean. 

Approximately one-half of the jobs in the Valley were in 
the service sector with a quarter in manufacturing. Un- 
employment in 1977-78 ran about 7.5 percent. Although the 
Valley is predominantly .jrfbite, the Hispanic population 
(11.6% in 1977) is growing and Open Road/New Jobs targeted 

' its services toward economically disadvantaged Hispanic 
youths. As Table. 1 indicates about 60 percent of Open 
Road/New Jobs youth were Hispajiic. In addition, there are 
other marked differences between the Open Road/New Jobs and 
Project Opportunity populations. Open Road/New Jobs youth 
were younger and mostly male (71%) . Most (68%) still lived 
with their families but a quarter claimed dependents of 
their own. Compared to Project Opportunity, Open Road/New 

—Jobs youth had less schooling (78% drop-outs vs. $4%) and 
had more difficulty reading (25% below fifth grade .level vs. 
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15%) . Work history differences were not as sharp. Rela- 
tively- similar pirepoplrions of Open Road/New Jobs and. Project 
Opportunity Phase r youths had held jobs at some time in 
their lives but more Open Road/New Jobs youths hel«d jobs 
during the year preceeding program entry. However f cbmpared 
to Project Opportunity Phase II youth's, Open Road/New Jobs 
participants' were less frequently employed before- program* 
entry (73% vs. 61%). In both programs, pre-progtam jobs 
tended to be fu^ll-time and paid about $3.50 :per hour. . 

- Ceteris paribus , it would appear that the^ typical Pro- 
ject Opportunity youth, white, older, with more education 
and better reading skil-ls would have an edge over the typi- 
cal Open Road/New Jobs youth in securing a job..^ 

Pre-Placement Training and Support Services 

Project Opportunity is a r.apid service model . Unless 
serious problems of a physical or psycho-social nature weire 
manifest, youth were accepted . into the program and placement 

.in a work experience setting began promptly. No pre-employ- 
ment training sequence was offered, by Project Opportunity. 
In retrospect, staff felt that . some basic pre-employment 
training .would have been beneficial. Open Road/ New Jobs, 
on the other hand, did incorporate formal pr e-placement # ser- 
vices via its two week long , four hour per day job -readiness 
workshop. Youths were pai'd minimum wage, for workshop atten- 
dance. The workshops, con&ucted by the two administrative 
staff members,-- used an assortment of activit iesr~to prepare 
participants for the world of work. Activities included 
personal skills assessment, occupational,, interest testing, 
role play simulations of job interviews, career pl;annir*g and 
goal setting techniques, and civics lectures. Guest; speak- 
ers representing a variety of occupations addressed the 
participants who were divided into classes of. approximately 
20. The training culminated with each youth composing, en 
Employment Development . Plan , which specif ied career goals,* 
as well as skills and work itfabits needed to -perform well 

* during the work experience traiifeeship. ' Ttvi-s doi^ument Was 
subsequently used to monitor "and discuss youths' performan- 
ces during the course of thejlr work experience. During the 
workshops, the ' Open Road staff also had an opportunity to 
identify particularly troubled youth and refer them for 
specialized help. ' 

However, the Open Road/New Jobs cyclical- intake system 
strained agency resources, especially the work load of job 
developers. Recall that after Cycle I, job developers *ere 
charged with lining up traineeships for their caseload of 
almost 20 new enrollees while attempting to find .^subsi- 
dized jobs' for youths who were completing their stint of 
work experience . Project Opportunity, on the othfer hand , 
with its continuous intake model offered no systematic pre- 
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employment training, A compromise approach might benefit 
both program models. Such a design might feature scal.ed- 
down two to three day workshops held eVery other week or so . 
This would diminish the overload evident in Open Road/New 
Jobs and provide increased screening and training capacity 
for Project Opportunity, 

Neither * Open Road/fclew Jobs nor Project. Opportunity 
formally offered specialized support services. However, job 
developers maintained close contact with youths and employ- 
ers during the placement period and built close relation- 
ships with both. This f plus the bent of both staff toward a 
social work model which responded to personal as well as 
career problems, resulted in job developers engaging ,in 
substantial amounts of counseling and referral. Even family 
counseling was not uncommon. In Project Opportunity, staff 
estimate tfiat*on the average each yai^th received 8.5 hours 
of counseling services and the estimates are higher in Open 
Road/New Jobs. r 

Attaining General Educational Development (GED) certifi- 
cation was emphasized for high, school drop-outs. Frequently 
the job developer would elicit a 'promise from youths that 
they would pursue a GED during their training, period . This 
pledge was also used to convince employers of a youth's 
motivation. In actuality, the pledge was honored more in 
.the breach than the observance. Across, .both programs 27 
youth enrolled in GED programs, but only five Project Oppor- 
tunity par ticipants and no Open Road/New Jobs youths act- 
ually completed their GED's.*^ 

Securing the Training* placement m - ' " 

In both • Proj-ect Opportunity and Open Road/New Jo'Jds, 
developirig subsidi zed^ work experience placements with pri- 
vate sector firms was. critical , and the -job developer was 
the key agent in this process'. A touchstone for youths and 
employers, the job developer was called upon to provide 
numerous services. ' * ' . . ^ 

• In dealing <with youths, £f)b developers in both programs 
evidenced similar styles. As noted, all .engaged in informal 
counseling. Further, none of the- job developers utililted 
standardized tests of interest or ability. .Prefer ring 7 *to 
rely* on their own Interviewing savvy, ea-rly meetings with a 
youth focused on explaining the programs and ass^ssing 
whether the youth really 5 wanbed to Ivork or not. Past job 
problems , reasons for current unemployment , and special work 
interests were ,discussedb and if the youth was accepted ihto 
the program (and practically all were) , job- developers would 
begin to seek a- training placement. 
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Open Road/New Jobs attempted to use a job bank which 
required lining up a sufficient number of placements to 
cover all new participants , in advance of intake. However, 
only about one in four youths were placed in job bank posi- 
tions. The rest, for a variety of reasons, required person- 
alized placement. For example,, certain job orders were 
cancelled or were already filled by the time a youth was 
ready for placement. A number of positions went unused 
because inadequate publ ic transportation made i t impossible 
for a youth to get to and from the business. Individual 
characteristics sometimes scuttled jobs especially for those 
youths whose English-speaking ability was weak and special- 
ized placements under Spanish-speaking supervisors were 
necessary. In retrospect the job bank technique proved, less 
than efficient, and gave way to an individualized job devel- 
opment approach . 

As noted, due to enroll ing, sizeable numbers of youths in 
separate waves, Open Road job placement was very pressurized 
and a continuous intake system would have been preferable. 

Different approaches characterized the employer solici- 
tation process. One job developer said he simply ^showed 
up" at a -place of business believing that this made it more- 
difficult to be turned away. If told that the owner was 
busy, this job developer would just wait it out. Of seven- 
ty-odd employers visited, each granted this job developer an 
audience. Other job developers contacted prospective emplo- 
yers by letter, followed by a telephone call, followed by a 
meeting. Still other relied solely on the telephone to make 
initial contact. Each initial contact, whether phone, 
letter, or drop-in, was preceded by information gathering to 
identify small businesses that were both within a youth's 
espoused occupational interest area and were geographically 
accessible. The Yellow Pages and the "grapevine" were 
extensively us^ but a number of placements were made in 
businesses that were identi f ied when a job developer hap- 
pened to see a firm's sign or delivery truck. 

Persuasive techniques frequently embodied a business- 
like approach wherein the job developer ^accented the "no 
risk" aspect (salary, insurance liability ,J and even bonding 
would be paid for by Project Opportunity and Open Road/New 
Jobs) . Fiscal incentives as well as lack of paperwork, the- 
youth's genuine interest in a particular line/ of work, and 
the absence ofo any obligation to hire aftei? the training 
were attractive features for employers. A second persuasive 
approach, which several job developers used, appealed to 
community pride and personal mission. This approach high- 
lighted tl{tf fact that the youth were disadvantaged and 
needed a helping hand if they were to attain solid positions 
within th.e' local community. ' Both the "business" and "social 
service" techniques seemed effective. However, employer 
interviews suggest that # the particular persuasive technique 
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may be less influential than personal qual iti es of the job 
developers, such as belief in the program and good communi- 
cation skills. 

The job developers initial employer interview was a key 
event. It not only gave the employer a chance to evaluate 
the program but afforded the program personnel a chance to 
evaluate the employer. Open Road/New Jobs staff related 
that one out of ten businesses were rejected by the program 
for reasons such as unsanitary or haphazard working condi- 
tions, inefficient management , and insufficient work. If 
the employer had. done previous training, job developers 
would check with the appropriate "agency and in several 
cases, where it was learned . that past training fell below 
standard, negotiations were terminated . 

On the average, of every ten firms that were contacted, 
four agreed to accept a -work experience trainee. Next, a 
three-way meeting was held with the employer, the job de- 
veloper, and the youth. This meeting was ordinarily held at 
the business site Where the mechanics of the program, such 
as the payment system, were reviewed and mutual expectations 
were refined. About one in fifteen employers, according to 
Job developers, opted xo reject a particular youth and ask 
for another. In most cases, a standard, three-pa^ty agree- 
ment was used to formalize the placement; the agreement 
detailed facets such as direct supervision by a designated 
member of the firm, youth attendance standards, reporting 
requirements, and the reimbursement system. Often, during 
this three-way meeting, but certainly during the early weeks 
of the placement ,. an explicit training plan was constructed. 
The plan set forth the progressive job tasks that the youth 
would learn and the skills that would be developed. *This 
plan became the basis for monitoring trainee progress. Job 
developers, during periodic visits to the business site, 
regularly checked to see if the youth was advancing in the 
job skills progression. 

In both programs, close attention was paid to each youth 
'during the early weeks, of placement. Because some had/ never 
held jobs, work problems were apt to arise during the first 
several weeks. For example, some participants didn't know 
to call in sick and a few even thought working three days 
each week was acceptable. The most common employer com- 
plaints' were lateness and absenteeism, and job developers 
would quickly attempt, to work with' the youth to correct 
early-on difficulties. 

After the firs.t month, job developers contacted emplo- 
yers and youths monthly, usually by visiting the work site. 
Employers , practically all felt that this' interest on the 
pprt of the job developer was a very positive factor . * It 
gave them the chance to discuss a youth's progress and rein- 
forced the employer's key role in the program. 
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The maximum time permitted for the work experience 
traineeship was six months. Although the flexibility of a. 
shorter placement existed, most were planned to run the full 
six month period. About midway during the six month period, 
job developers began investigating the prospects of the 
youth ' s being hired in an unsubsidi zed' position when the 
placement period was over. In a few instances, when money 
was the issue, job developers negotiated a formal OJT con- 
tract under which the youth , remained- with the employer for 
up to six more months with 50% of the youth 1 s wages being 
paid by prime sponsor dollars. In other cases, where the 
chances were slim for permanent placement (usually because 
of sagging business activity), other local job opportunities 
were sought • 

The next chapters addresses the youth's transition to 
unsubsidized employment at termination while Chapter IX 
provides several suggested program improvement-s. By way of 
summarizing the programs' operations, with the exception' of 
problems related to the screening process and the strain 
created by the Open Road/New Jobs cyclical intake system, 
the programs appeared to operate smoothly and efficiently. 
Youth were generally placed within two to four weeks in a 
well designed training experience with interested employers. 
While the presence of a skilled program administrator was 
imperative to each program's smooth operation and the in- 
centives to employers facilitated business involvement, the 
programs' keystone was the job developer who delivered es- 
sential and multiple services to both youths and employers. 
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CHAPTER IV; TERMINATION AN AL YSIS 
PROJECT OPPORTUNITY AND OPEN ROA'57dEW JOBS 

This chapter studies ah important immed i ate * outcome of 
program participation: youth status at program termination. 
It has been pointed out that analys is of youth status at 
termination provides useful information on the ef f ect iveness 
of the programs in achieving immediate employment for youth 
and provides a means, for assessing the degree of wastage of 
resources as reflected by nonposit ive terminat ions • 

The chapter describes and analyzes the types of termina- 
tion experienced by the 292 participants in Project Oppor- 
tunity and Open Road/New J,obs. The first section sets forth 
the distribution of various termination types in order to 
gauge how well Pro"' Opportunity and Open Road/New Jobs 

rates of job place. and other positive terminations ap- 

proximate those in o r selected youth programs. Then, the 
kinds, of job placements are inspected as are the relation- 
ship of jobs to youth's training experiences. Next, we 
contrast the outcomes of youths who completed their program 
with those who left prematurely. Finally, in order to iden- 
tify the effects of certain part icipant and program charac- 
teristics upon termination status, the results of several 
regression ^analyses are examined. 

Types of Termination 

Reasons for termination have been classified into one of 
the following four major categories (cf, Sawhney et al, 

1978): \ 

j\b Placement : This category includes all youths 
who, within thirty days of leaving their pro- 
grams, were either placed in jobs by their 
programs or found jobs on their own • 

Other Positive Termination : This category con- 
sists of youths who, upon leaving their pro- 
grams , returned to school or entered other 
training programs or entered the military, — 

Nonposit ive Termination : This category includes* 
youths who terminated because of disinterest, 
dissatisfaction, disciplinary problems, and 
unsatisfactory attendance as well as those not 
placed within thirty days of their exit from the 
program* 

Other Termination : This group consists of youths 
who withdrew from the programs because of per- 
sonal problems, including, health, transporta- 
tion, and moving out of the area. 



Table 2 presents the major reasons for termination from 
the three. programs. Interpreting these data is not straight- 
forward. The raw figures" indicate an overall positive 
termination rate of 61 percent (43% + 18%) and a job place- 
ment rate of 43 percent. In isolation, the figures may be 
misleading.. For example, Project Opportunity J was abrand 
new program model with a new staff. During its beginning 
months it had difficulty recruit ing participants and its 
positive termination rate was low. From the midpoint of the t> 
program -- January 1980 through November 1980 -- a much 
higher positive termination rate was sustained. Not sur- 
prisingly, a learning curve seems to b^j^i^ident wherein 
early snags are corrected and more positive' outcomes result. 

TabJL e' i** r \ ... . ( 



Types of Termination; PO and OR / 



• 


PO 


•I 


PO 


II 


OR/N J . 


Total 


< 


n 


% 


n 


% 


n . 


% 


n 


% 


Job Placement 


36. 


29% 


41 


33% 


48 


44% * 


125 


43% 


Other Positive 


33 


27% 


4 


7% 


16 


15% 


53 


18% 


Hon Positive 


36 


29% 


11 


19% 


24 


-22% 


71 


24% 


Other 


14 


11% 


8 


. 13% 


21 


19% - 


-4 3 


15% 


Total. 


124 




59 




109 




292 



External conditions also influence^ outcomes, Both the 
Wisconsin and Los Angeles areas were hard-hit by recession 
during 1980. Jobs became scarce., and .as has been pointed 
out: "Regardless of how well work experience or other em- 
ployment and training programs may be administered ,' their 
overall effect will be severely limited if there are short- 
ages of jobs in the areas where they take place" (Mangum and 
Walsh, 1978, p. 59). Unfortunately , these data are not 
finely textured enough to measure the effects of a shrinking 
job pool* upon program performance. 

Several other conditipns make' it difficult to compare 
these programs^ to o±her efforts. First, there are hardly 
any other work experience programs that subsidize private 
sector employment. Second, formula- funded work experience 
programs deal with a range of populations and entertain 
different program objectives." Third, recent study has cast 
doubt upon the utility of termination data in evaluating 
program effectiveness, especially with a youth population, 
because termination status is simply not a sound predictor 
/of longer term program impact (P/PV, 1982). 



2 



31 



ERIC 




■9 



* C\e&Xiy 9 definitive judgments of a policy nature ^hould 
be 3rawf> from termination data alone. * However , ^gross 
J £^eret*t$ can be useful in determining whether or not Pro- 
3*tft O^Portu n ^ty of Open Road/New. jobs appear to be roughly 
C^par^^ie t° Established programs. According to Department 
°S L^b°* statistics/ national YETP programs during fiscal 
¥^&t l9%% a^hi^ved a job placement ^rate of 19% - less than 
th^t o f Project Opportunity and Open Road/New Jobs 1 
c^tibin^ d 43 Percent rate.- Adult work experience .programs 
nationally reported that roughly five out of ten par- 
ti^ipat*.t§ are Employed at. program* exit compared to four out 
°^ ten it* P*r°j^ct Opportunity and Open Road/New Jobs. 

A itf°te gettttane comparison is with the Public vs.. Private 
S^tftor ^ob Detft ons tration Project , which operated in five 
s t^es co n 'teinpo ra neousiy with Project Opportunity or Open 
K ^d/N# w jobs ( c f. Gilsiman and Tomey, 1980). This research 
*^g?ort£ termination data on over 2 , 000 ^economically d isa-d- 
v ^wtag^ d youth's who were placed either in small businesses 
o*: in PUbli^/^onprof it agencies at 100% subsidy f or * up to 
.ftye tn<? n t:hs. It concluded that private sector work experi- 
&\&e i B superior to the classical public sector mode in 
t^ms jot? Placement. Demographically , these, youth were 
sightly olde r . (mean a ge of 18.9) than Project Opportunity 
°^ OPef* Road/ N ^w Jobs youth. In addition, 53% were women, 
9$^ hi<2 h school drop-outs, and 64% black. 

x/ Th^ Pub^-- 1 ^ vs. Private Demonstration did not report 
t^min#ti 0 n data according to public vs private work exper- 
iences* it di<3 report that of all participant youths,* 40% 
t^^min^t^d poSi t i ve ly with 30% of the^se attaining unsubsi- 
^t^e^a ^ploy^^nt. hs Table 2 shows, youth from Project 
^£?ortU n ity anc3 Open Road/New Jobs did substantially better 
botP eounts % in short, the Project Opportunity and Open 
R ^d/N0 w Jobs Models compare adequately with selected rela- 
te ef^o tts% 

oj^ Job^E ^acements, and Their ReTation to the Training 

O v ^ r Whe Ji^ingly / the jobs that the youth obtained at 
t^^min^tion w ^re both unsubsidized and permanent (95%). 
^t?s W e ^e di s tributed fairly equally across occupational 
c ^e<3of i^s although Open Road/New Jobs tended slightly 
t^ya£d ^nuf actur ing positions whi le Project OpjSortun ity I 
c l^ste r ^d m° r ^ in clerical, sales, and service fields, 
P^hap^ $ refaction Q £ the differential sex composition of 
t\ 9 two Programs . x , 

In °^en R 0 ^d/New Jobs and Project Opportunity I training 
coi^ s ^iously matched to a youth f s occupational interest, 
H "the h Qpes 'that the youth would gain a lasting, foothold on 
a ^ a z e ^ r path w ^y. Given that such matching distinguished 
^Ws e ^ r agrafli s and represented a sizeable investment , it is 
*^o£t# n t: to ^termirie the extent to which the type of job 
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gained upon termination related tfc the training experience. 
The programs achieved a high degree of ^success on this di- 
mension. Of 89 youth placed at termination by the two 
programs, staff report that 80 were placed in. jobs directly 
relating to the work performed during the program. 



Completers vs . Non-completers 

A useful dichotomy in evaluating programs 'is to contrast 
youth who left the* program prematurely with those who com- 
pleted training. All things being equal, we would expect 
completers , given their lengthier training and access Y to 
programs' jobs placement services, to outperform non-com- 
pleters. The data in Table 3. support this __hypjthesis , i.but 
also indicate that less than 50% of the youth completed 
either program./** 

Table 3 % 

Activity Status at ; Termination: 
Completers vs. Noncompleter s PO I and OR* 



PO I. 



OR 



Combined 



Comple- 
ters 



Noncom- 
pleters 



Comple- 
ters 



Noncom- 
pleters 



Comple- 
ters 



Noncom- 
pleters 



Percent 

- in Jobs 47% 

Percent 
in School 9% 



23% 



4% 



82% 



4% 



17% 



9% 



63% 



7% 



20% - 



6% 



Percent in 
Tr-aining 25% 



Percent in 
MiTTea^y 6% 



11% 



4% 



2% 



0% 



8% 



3% 



14% 



3% 



10% 
3% 



Total Percent 
Positive 87% 



n 



53 



42% 
71 



88% 
45 



37% 
64 



87% 
9.8 



39% 
135 



*Note: Data not available for PO II. 



In Project Opportunity and Open Road/New Jobs, almost 
9 0% of completers terminated positively, a rate more than 
double that of non-completers. Completers in Open Road/New 
Jobs were more than five times as likely to hold a job at 
termination than non-completers; in Project Opportun i ty the 
differential was not as great, but completers still gained 
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twice as many jobs as non-completers # Interesting !y, non- 
completers in Open Road/New Jobs were ^ore likely fc o entet 
school-, training/ and the military wtule the converse held 
true in Project Opportunity. ' 

Because* program completion almost: guaranteed 50it\ e form 
of .positive result at termination, we examined what charac- 
teristics affect the likelihood of ^ program completion. 
Table 4 presents selected characteristics of Completers vs. 
non-completers in Project Opportunity I and Open Road/New 
JoJds. The fact that non-completers in project Opportunity 
had significantly lower pre-program wages and preprogram 
readying levels suggests that the more able participants 
remained in the program. . A similar pattern did n^t appear 
in Open Road/New Jobs as none of the background character- 
istics significantly affected completion. 

We further explored the effects of participant charac- 
teristics upon length of stay in the program by using multi- 
ple regression analysis. Our model specified that hours of 
program participation depend on the £64 lowing* pr e ""prog ram 
characteristics: age, sex, ethnicity* educational level, 
reading ability/ and whether or not the youth held a j°b 
within twelve months prior to intake. Table 5 contains out 
results. In Open Road/New Jobs, only Hispanic ethni c ity had 
a statistically positive effect on t i^ spent in th e pro- 
gram. For the Project Opportunity program, °\it univariate 
results persist as youth with higher reading ability and 
high school degrees stayed longer i ti Project Opportunity. 
These results suggest that Project Opportunity should have 
perhaps paid more attention to identifying 'the ob sta cles 
that the less competent youth encountered and to formulating 
ways to retain them in the training. 

Effectjs^gf Hours of Program Participatio n 

In order to examine the effects of length Of time in the 
program, we again used probit analysis Table 6 Presents 
our results. For the Project Opportunity I Program, hour's 
of program participation and high school diploma ^froth ap- 
proach statistical significance and positively affect job 
status at termination . For Open Road/New Jobs, hours of 
program participation strongly predict gaining^ a job at 
termination but; having a high school diPloma do e s not have a 
significant effect. In both Project Opportunity atld Open 
Road/New Jobs, neithe^ sex nor age not: ethnicity nor reading 
ability nor holding a pre-program job significantly improved 
participant chances of obtaining a job upon termination. 
For both programs it appears that reading ability influences 
final outcome by its effects on hours of participation. 

In our multivariate models we also divided hour 15 of pro- 
gram participation into four interval s representing m0 nths 
of stay in the program. For Project Opportunity, the longer 
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Characteristics of £ ompleters_ vs -florico mpleters : PO-I and OR 



PO I 




OR 



Non- \ Npn- 
C^jg^leters Compl eters Completers Completers 



Percent male 

Average age 

Average reading 
level 

Average pre-p^Qgram 
- wage 

Average pre-program 
hour£ Worked 

Had pra-prog^am job 

Percent White 

Percent Hispanic 

Had high school 
degree 

Total hours in 
pro<J r am 

N 



43% 
18.69 
'8.8 



$ -3. 66 
37 . 3 

$4 



39% > 
18.56 
8.1* 

$ 3.04* 

37.0 

48% 
94% 
4% 
39% 

324* 
71 



70% 
. 18.30 
7.3 

$ 3.27 

V 

36.0 

23% 
64% 
19% 

79'0 
47 / 



72% 
18.02 
. .6.8 

$ 3.85 

36.3 

47% 
31% 
55% 
25% 

304* 

64 . 



NOTE: Deita not avail#t>le for PO-II 



* Difference in means statistically significant at' the .05 level. 



Ordinary Least Squares Regression Explaining 
Hours of Program participation; POI ,and OR 
' (t-ratios in parentheses) 

Variable POI OR 



Sex 



Age At Intake 

< - , f 

1 = 18 or over -2.ff0 W' 54 

' ..(--03) H.34) 

1 = make *29.19 -39.18 

. . (.41) - (-.55) 

Ethnicity X . 

1 = white, O otherwise 38.71 

(.23)., ^ 

1 = black otherwise - . • 142.59 ■ 

(1131) 



# of Observations 



V 



1 = Hispanic, O otherwise - 149.41 

(2.01)* 

Education ^ / 

1 = High School Graduate 153.80 -10.48 

(1.98) * (-.13) 

ABLE Reading Score 270.56 2 3.91 
: (2.33)*\ (1.46) 

Pre-Program Job Within 91.50 3. 34 

12 Months of Intake (1.18) (.05) 

1 = yes 

Constant 187.24 229.88 

< .98) (1.54) 



R .10 ^ .06 

Mean Value of 562'.8 491.8 

Dependent Variable 



125 106 



*Indicates statistical significance at the .05 level. 



4? 



Table 6 

Probit Analysis Explaining Job 
at Termination: POI and OR 
(t-ratios in parentheses) 



Variable 



POI 



OR 



Age At Intake 



1 = 18 or over 



-.02 
(-.05) 



.20 
(.66) 



Sex 

1 = male 

" 

Ethnicity ' . ■ 

i = white, otherwise 

1 - Hispanic, 0 otherwise 

1 = black, 0 otherwise 

Education 

1 =- High School Graduate 

ABLE Reading Score 

Hours of Program Participation 



Pre-Prpgram Job. Within 
12 Months of Intake 

Constant 



Chi-Square 
Degrees of Freedom 
Log of Liklihood 
Proportion Y=l 
Number of Observations 



-<-.09 
(-.32) 



.32 
(.44) 



.19 
(.59) 



.52 
(1.76) 

.08 
(.59) 

,0007 
(1.86) 

.37 
(1.33) 

, -2.30 
(-1.81) 

13.84 
7 

'-61.50 
.32 
109 



-.43 
(-1.28) 

-.69 
(-1.33) 



-.30 
(-.82) 

' ■ .08 
(1.09)" 

.002 
(4.54) * 

.43 
- (1.48) 

-1.92 
(-2.69) * 

30.05 
8 

-57.-52 
' .43 
106 



♦Indicates statistical significance at tne .05 level. 
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the person stayed in the program the higher the probability 
of having a job at termination . The results for Open Roads/ 
New Jobs were somewhat similar except that our results indi- 
cated that length of stay became a factor in job attainment 
only for participants who stayed in the program for at least 
three months. 

In summary, we found that the job placement rates of 
both Project Opportunity I and Open Road/New Jobs compared 
favorably with the job placement rates of other Department 
of Labor youth training programs. We also f ound t a marked 
improvement in job placement rate between Project Opportun- 
ity Phase I and Project ' Opportunity Phase II. In addition , 
the programs were successful in placing participants in j obs 
relating to their program experience. 

• ■ * 

Multivariate analysis suggested that hours of program 
participation positively affected the probabi lity of having 
a job at termination f,or both Project Opportunity Phase I 
and Open Road/New Job.s. For Project Opportunity Phase I, 
youth with high school degrees and higher reading test 
scores tended to remain in the program. No such result was 
found for Open Road/New Jobs. * , 
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CHAPTER V. PARTICIPANT FOLLOW-UP RESULTS 



In this chapter , we focus upon data from follow-up in- 
terviews with Pro ject Opportunity I and Open Road/New Jobs 
participants. Attempts were made to interview participants 
in each of the two. programs eight months after termination. 
It is "important to efhphasize hfcre that the results' in this 
chapter % do;, not include any comparison group analysis. «In 
the abserice of- a comparison group, pre * to post-program 
changes in 0 labor market outcomes, cannot be uniquely attri- 
buted to program effects. Changes in economic conditions or, 
the natural effects of aging could be responsible for such 
changes over time. The results in this chapter, then, 
should be interpreted with, caution . 

The Follow-Up Samples r . 

An independent survey research firm was engaged to t^ack 
and interview each yoyi^h eight months after program^ termi- 
nation. Of the 125 youths who entered Project Opportunity 
I, interviews were successfully completed k with £8, a re- 
sponse, rate' of "70%. Fori Open Road/New Jobs, a 60% interview 
completipn rate was achieved as 65 of the 109 participants 
were interviewed. A major concern was that, due to attri- 
tion, the follow-up. samples might differ from the original 
program .populations. ' If systematic .differences between the 
original and the follow-up samples e^ist, a variety of, 
biases could be introduced into the analysis.', To check for 
attrition, respondents :and .non-respondents were compared on 
over twenty background \ characteristics.- In Project Oppor- 
tunity I, a statistically significant di fference between the 
two groups .was that hon-respondents/were younger (18.3 as 
.opposed to 18.8' years 'old at intake).,' and they also were 
significantly more* likely to have held pre-prog ram- jobs (79% 
vs 61%). In Open .Road/New ^Jobs * ho significant differences^ 
in background characteristics were found between- respondents 
and non-respondents. Eased' on these analyses, it appears 
that the .follow-up samples are acceptably representative of 
the original, pool of program ^participants . 

Post-Program Outcomes: 'Pro ject Opportunity* I afi'd Open 
Road/New, JofrS . " ;; * % * . * 

Table 7 displays outcomes for the Project ^Opportunity I 
and Open Road/New Jobs par ticipants at 'termination .^nd eight 
months after termination. * ' 

As the table indicates, Open Road/New Jobs participants 
exhibited gains in both employment and in hourly wages . The 
wage increase is especially sharp with .average hourly pay 
jumping by 50£ per hour from time of termination to the 
eight-month follow-up. # Project Opportunity, I youth, while 



f 50 



making substantial gains in the rate of being employed did 
not experience overall wage gains and dropped In their week- 
ly hours worked by five, Both groups retained approximately 
equal rates of participation in some positive activity (job, 
school, military, otiher training) . 



Table 7 f 

Comparison of Selected Termination 
and Follow-Up Outcomes 



• PO • OR, 

' * At fermi- 8-Month -At Termi- 8-Month 

• > _ nation Follow-up ' ^ nation * Follow-up 

Percent .with 33% 49% 44% 54% 

jobs . • 

Mean Wages for $3.51 $3.51 $3.85 $4.39 

those with jobs 

Average hours 3 6.2 31.2 3 8.*2 3 7.5 

worked per. week . 
for those with * ' it ,< 

jobs ^ 

Percent in posi- 60% 57% 3*9%* 61% 

tive activity 
>(i.e. school, 

military, etc.) 0 v 

rt 124 87 109 65 

Program Completers vs. Non-completers 
> ~" 

^Table , 8 Separates the Open Road/New Jobs and Project 
Opportunity eight-month ftfl-low-up results into program com- 
pleters and non-completers. 
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Table 8 



Eight-Month Outcomes for PO and OR by Completion Status> 



t Non- Non- 
Completers Completers • Completers Completers 

Percent with 

Jobs ' 64% " 38% . 79% 35% 



Mean wages of 

those with jobs $3.46 , $3.54 $4.44 $4.35 

Average hours 
per week of 

those with jobs 30. 0 32.2 39. 1 36.0 

Percent in 

positive _. Ka 
activity 82% ' 65% 93% 59% 



n 



3.9 ' 48 J 28 . 37 



In terms of employment and positive activity, it is 
clear that prbgram completers did better than non-completers 
in both programs at follow-up. In Open Road/New Jobs, com- 
pleters also outperformed non-completers in their hourly 
wages arid their weekly work hours. This is Hot the case for 
Project Opportunity where non-completers who did find jobs 
logged higher wages and more work hours. It appears that, 
with respect to Project' Opportunity, non-completers have a 
more difficult time finding a job than completers, but the 
jobs they do find pay at least as much or more than those 
found by the program for completers. 

Effects of Length of Stay in Program 

We used multivariate analysis to determine the effects 
of length of stay in the program on labor market outcomes at 
follow-up. In these models, hours of program participation 
did not have a significant .effect on employment status and 
positive activity status for either program. The statis- 
tical results of these models are presented in Appendix A. 
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With respect to weekly earnings at the »e ight -month 
follow-up (cf. Table 9) , hours of program participation have 
a significant positive effect on weekly earnings for Open 
-Road/New Jobs youth. For Project Opportunity, being male, 
being white, and having a pre-program job all were signifi- 
cantly and positively related to higher earnings. However, 
in Project Opportunity^. the hours of participation variable 
was negatively aad-^igni f icant ly related to participants 
post-program weekly earnings. 

From these analyses , it appears that length of stay in 
the program did not increase a youth's chances of subsequent 
employment or "positive activity" in either program. For 
Open Road/New Jobs, however, the more time that a youth 
spent in thfe program, the higher the subsequent earnings. 
The negative relationship between hours of participation in 
the Project Opportunity program and earnings is puzzling. 
What appears to be happening is that youth who drop out of 
the program do not increase their chance of employment, but 
if they do find a job it will pay as much as or more than 
the jobs found through the program. i 

However, our analysis 'of participant follow-up results 
falls short of assessing the net effects of program partici- 
pation.- Other factors, such as local employment conditions, 
ce.rtainly influence job acquisition and reta i nmen t . In 
spite of the program 1 ^ seemingTy poor showing in terms of 
post-program youth employment and Project Opportunity's 
failure to increase wage gains, it is possible that compared 
to similar, youth who were not offered training, the programs 
have substantial impact. This is addressed in the following 
chapter. 
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Table 9 



Tobit Analysis of Weekly Earnings 
at Eight-Month Follow-Up: POI and OR 
(t-ratio's in parentheses) 

Variable POI OR 



Age At Intake 



Sex 



1 = 18 or over 2.81 ^5.19 

(.11) -.20 



1 = male 36.48 -22.43 

. (2.07)* (-.68) 



Ethnicity 



1 ■ white, 0 otherwise 80.26 ■ -44.67 

(2.00)* (-1.15) 

1 = Hispanic, _ 2.77 

0 otherwise (.08) 

Education 

1 = High School Graduate 31.15 -107.99 

(1.68) (-3.45)* 

ABLE Reading S core ' 12.26 • T 5 ^ 19 . 
: (1.70) (-.20) 

Pre-Program Job Within 43.93 38.27 

— 12 Months of Intake (2.57)* (1.59) 

1 = yes 

Parent's Educat ion 19.17 . 11.19 
; - (1.57)' > (.79) 

Hours of Program Partici pation -.07 .08 
2 (-2.83)* (2.14)* 

Constant -178.62 29.78 
(-2.31)* (.46) 



164.62 



Sigma 

Mean Value of 

Dependent Variable 
(non-limit. observations) 

Number of Observations 69 J » 54 

Mori-Limit Observations 48 K 44, - 

*Statistically significant at the level. 

Note: OR Tobit was run using method of moments rather than maximum, liklih 
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CHAPTER VI: IMPACT ANALYSIS 



In this chapter we use* a comparison group methodology to 
estimate effects ofr Project Opportunity I cn labor market 
outcomes eight months after program participants had left - ' 
the program f The focus is upon three outcome measures — 
employment states, positive activity status (i.el, work, 
school, training, military), and earnings. Before- present- 
ing our f ind ings sever a 1 design factors are d iscussed • 

Research Design and Sample Selection 

The scope of the analysis in this chapter is limited to 
Pxoject Opportunity I. Because of several facto'rs, the 
Department of Labor cho^e not to obtain comparison groups 
for the Open Road/New Jobs or the Project Opportunity II 
programs. The reader is cautioned that this restriction 
curtails the genera 1 izab i 1 i ty of our findings since results 
are confined to a single program operating in a singular 
content, -rural Wisconsin . Participants in Project Oppor- 
tunity I were interviewed approximately eight months after 
they completed the program . Timing for each of the compar- 
ison group subject's follow-up interview followed this 
formula : 

baseline 5 months 

interview + (average par- + 8 months 
date ticioant length 

of stay) 

The participant and comparison samples ere not randomly 
selected. Participants were referred to the Project Oppor- 
tunity program from $ variety of sources — the state Job Ser- 
vice, the school system, other youth programs, and through 
word of mouth . The Job Service .was the pr incipal source, 
referring roughly 50% of all participants. Once a you^h was 
referred" to the program, counseling sessions were u^ad to 
determine if the Project Opportuni ty program fit the . needs 
of the youth. At least at the start of the program, almost 
all youths interviewed were accepted into the program. 
Project Opportunity staff reported however that a few youths 
turned down the chance to enter Project Opportunity saying 
that they could get better jobs on their own. 

The comparison group was put tog-ether from a variety of 
sources in & catch-as-catch-can manner. Youths who turned, 
down the chance to enter Project Oppor tun i ty were asked to 
fill out comparison group forms. Youths at the Job Service 
who were being referred to other programs were asked to join 
the comparison group as long as they met PO's income eligi- 
bility criteria. Finally, Project Opportunity staff visited 



8-month 
follow-up = 
interview 
date 



other projects run by the parent ADVOCAP agency and collect- 
ed some comparison group members there. In particular, 13 
youths who were in the process of enrolling in (or later en- 
tered) ADVOCAP 's Supported Work program were inducted in the 
comparison group. Further* ten youths in the participant 
group and a like number in the comparison group had been in^ 
Supported Work at some time in the past. 

. Job counselors at the State Job Service reported that 
Project Opportunity was a program that served youchs within 
the middle-range of' empl oyab i 1 i'ty . Based on counseling 
interviews and test scores, Job Service youths were assigned 
to a variety of employment programs. Youths with particular 
career goals in mind were referred to the State's technical 
school system or to OJT slots in specific occupations. 
Youths needing to explore career opportunities, but motivat- 
ed enough to follow through in a job program were referred 
to Project Opportunity. Youths requiring slightly more sup- 
ervision were referred to public sector work experience pro- 
grams. Job service counselors report that Supported Wcrk 
served* a different type of clientele altogether — youths 
who were ex-offenders,, had drug problems, or who had next- 
to*-nothing in terms of employab i 1 i ty . 

It is difficult to reconstruct exactly who the compari- 
son youths were who were collected at the Job Service Of- 
fices. Job Service counselors report that during the 1979- 
1980 period they attempted to find appropriate services for 
each CETA-el igible youth who came to them.' The comparison 
group, then, was in part made up of youths who went on to 
•other training programs. Alternatively, some of the com-' 
parison youths solicited by the Job Service probably decided 
on their own against entering the program suggested to them 
or found jobs on their own before their aptitude test or 
counseling session could be set up. 

Given the way in which the participant and comparison 
samples were chosen, it is evident that selection biases 
"were introduced at a number of different levels. State Job 
Service counselors had a range of programs to which they 
could refer CETA-el ig ible , out-of -school youths, and appar- 
ently they saw Project Opportunity, as a program for youth 
with middle i" of the range employabil ity . Once the youths 
were referred to Project Opportunity, program counselors in- 
terviewed them, and at least a few were selected out because 
of severe personal problems. Finally, several selected 
themselves out upon hearing more about the program because 
they thought they ■ could do ' better on their own. Because 
much of the comparison group was picked from youths who were 
selected out of the program at one of these levels - and be- 
cause the 1 program was seen as occupying a middle ground in 
the range of employment services - a case could be made that 
the comparison group does not represent the same type of 
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youth as "the participant group, but rather represents clus- 
ters of youths who are either more job-ready or less job- 
ready, than thje participant ypuths. 

f 

While we do attempt in our analysis to control for 
selection bias between the two groups, we are not completely 
confident of our ability to do so. The resul ts of our an- 
alysis in this chapter, therefore, need to , be interpreted 
wi th caution. 

Participant and Comparison Group Characteristics 

Al 1 par t/ic ipan t and compar ison youths had to meet CETA 
income eligibility criteria and had to be between the ages 
of 16 and 21. Statistical tests were run on twenty-five 
demographic, educational, and pre-program work experience 
Characteristics to check on possible systematic differences 
between compar i son and participant youths . Compar ison 
youths had slightly higher values for all pre-program mea- 
sures, including percentage with high school degrees, per- 
centage with pre-program jobs, reading ability score, pa- 
rents' education level, and pre-program wages. However, the 
only statistically significant differences were that the 
mean age for comparisons was 19 years as opposed to 18.6 for 
participants and that comparison youths were more likely to 
be l'iving . on their own while Project Opportunity youths 
tended to be family members. \ 

«<? 

We also assessed attrition di f f erences between the two* 
groups. In the comparison group, 85 of 125 (68%) responded 
to the follow-up interviews. Differences/ between the non- 
t, spondents and respondentia in follow-uti interviews were 
tested on twenty backgrourJd character istlics and only two 
significant differences wete found. yon-respondents had 
9 fewer dependents (hence may have been^more mobile and dif- 
ficult to track) and 'were less likely to have ever worked 
before. In general, these were similar patterns to those 
found among non-respondents fronfc the participant group sam- 
ple (see the discussion in the previous chapter) . Attrition 
does not appear to have had any differential effects between 
participant and compar ison samples. 

fir ft H 

Part ic ipan t/Compar ison Resul ts 

Table 10 presents mean values for selected pre- and 
post -prog ram charac teiristics of our participant and corn- 
par ison samples . 

As is clear in the table, the slight although not sta- 
tistically significant pre-program advantages of the com- 
parison groqp were carried over into the post-program peri- 
od. ' Eight monLhs pos t/-£rogram — and over a year after the 
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Table 10 



Participant vs Comparison Samples : 
Selected Pre- and Post-Program Variables 

Participants . Comparisons 

Average Age 18.6 18.9* 

% Male 41% 46% 

% White 95% ' 95% 

% High School Diploma 45% 49% 

% Ever Held Pre-Program Job 51% y 65% 

Average ABLE Reading Score 8.4 8.6 

Pre-Program Average Wage $3.34 $3148 

% Post-Program Job Holders 49% 52% 
Average Post-Program 

Weekly Earnings** $111.43 $124.79 
Average Hours Per Week 

on Post-Program Job**, 32.2 31.4 
Average Post-Prpgram 

Hourly Wages** $3.51 $3.73 

* Indicates statistical significance at the 95% level. 

** Pertains only to youths holding {post-program jobs at the^ 
time of the eight-month interview. 



baseline data were collected — the comparison group contin- 
ued to lead the participant group in the outcome measures of 
hourly wages and percentage" holding a job, although neither 
difference is pronounced enough to v be statistically signifi- 
cant. 

The results in Table 10 do not, control for participant/ 
comparison differences (e.g., age, sex, and education) that 
could influence labor market success. To take into account 
observable differences between, the two groups, we used mul- 
tivar iate models to estimate program effects on on post- 
program employment status, positive activity status, and 
weekly earnings. 

We also- attempt ' in these models , to control, for selection 
bias between the participant and comparison samples. To 
deal with selection bias, we make use of a recently devel- 
oped e/conometric procedure which attempts to control for un- 
observable characteristics of sample youths which jnaay have 
influenced their selection into the program (Heckman, 1979; 
Mathematica Policy Research, 1980). Appendix B provides a . ? 
more detailed discussion of this procedure. 
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Tables 11 and 12 present the final results of program 
impact on employment status, positive* activity status, and 
weekly earnings. The. lambda variables in the models reflect 
our attempt to control for selection bias. The quarterly 
variables in the models reflect our attempt to control for 
the fact that the comparison youths were disproportionately 
interviewed during the spring and summer quarters, when em- 
ployment opportunities may be greater in northern Wisconsin. 
Individual characteristics which we also controlled for in 
the models include age, sex, ethnicity, education, ABLE 
reading score, and whether the individual had a pre-program 
job within 12 months of intake. 

Program participation lacks a statistically signi f icant 
effect on any of the outcome variables considered here. <En 
equations predicting employment status and positive activi- 
ty, the program effect is positive and insignificant. Tn 
the earnings • equation , the effect is negative and insignif- 
icant . The key variables explaining employment status and 
positive activity status are pre-program job within 12 
months intake and reading ability test score. Pre-program 
jcb within 12 months of intake is also a key predictor^ of 
subsequent earnings. . • ' 

These results suggest that Project Opportunity I was not 
able to affect the subsequent labor market outcome of par- 
ticipants positively. These results need to be interpreted 
with some caution , g iveh the methodological problems des- 
cribed earlier in this chapter regarding the selection of 
the comparison group. Also, it should be stressed that 
these outcome result's pertain only to Project Opportunity I. 
Both Open Road/N£w Jobs and Project Opportunity II had much 
better p::e- to post-program earnings gains than Project Op- 
portunity I, and an impact analysis of these two programs 
could reverse the finding that participation in Project Op- 
portunity I did not improve yoiPths ' labor market prospects. 
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Table 11 



t 



. Probit Analysis of Employment Status and Positive 
X ^ctivity Status at Eight-Month Follow-up: POI 
(t-ratios in parentheses) 



Var iables 



Ethnicity 
1 = White 



Education 

1 = High School Degree 

Parent's Education 



Employment 
Status 



29 

(-.57) 



.14 
(.56) 

-. 14 

(-.79) 



Positive 
Activity 



-.43 
(-.81) 



. 04 
(.16) 

'{> -.05 
(-.29) 



Age 



1 = 18 or over 



-.20 
(-.59) 



-.02 
(-.05) 



Sex 



Tl = Male 



Pre-Program Job Within 
12 Months of Intake 

ABLE Reading Score 



1 

Lambda 








Interview 


in 


2nd 


Quarter 


Interview 


in 


3rd 


Quarter 


Interview 


in 


3rd 


Quarter 



Constant 

Chi Square 
Degrees of Freedon 
Proportion Y=l 
Log of Likelihood 
Number of Observation 

^Indicates statistical' significance at the .05 level. 



- 31 


-.41 


(-1 30V 


(-1.69) 


.56 


.39 


(2.38)* 


(1.68) 


.24 


. 25 


(2.09) * 


(2.27) 


o -. 60 


. -.56 


(-1.15) • 


(-1.09) 


.40 


. 27 


(1.14) 


(.78) 


-.04 


. 14 ' 


(-.09) 


(.31) 


.10 


. 06 


(.21) 


(.12) 


.44 


.29 


(.97) 


(.52) 


-1.35 


-1.20 


(-.96) 


(-1.20) 


18.72 


15.60 


12 


12 


52 


.61 


-91.71 


-89.87 


146 


146 



Table 12 

Tobit Analysis of Weekly Earnings 
at Eight-Month Follow-Up: POI 

Variables ^ , Coefficient t-ratio 
Ethnicity 

1 = White ' -59,50 -1,87 
Education 

1 = High School Degree 3.23* .20 

Parent ' s Education ^ -,4 8 -.04 * 

Age 

1 = 18 or over 41.62 1.91 
* 

Sex 

1 = Male , 5.82 .39 

Pre-Program Job Within 45.24 3.12* 
'12 Months of Intake 

ABLE Reading Score 1.68 .26 

Program Participation -45.73 -1.39 

Lambda 2 6. 03 ' £ 1.21^ 

-10.87 -.38 



Interview 


in 


2nd 


Quarter 


Interview 


in 


3rd 


Quarter 


Interview 


in 


4th 


Quarter 



-8.66 -.30 
35.86 1.27 



Constant . 6 3.65 .77 

Sigma 69.94? 
Mean Value of Dependent Variable 119.44 

(non-1 imit observations,) 
Number of Observations 146 
Non-Limit Observations , 102 



*Statistically significant at the .05 level. 
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CHAPTER VII; COST-EFFECTIVENESS: PROJECT OPPORTUNITY' 



AND OPEN ROAD/NEW JOBS 



Ideally f a comprehensive assessment of the cost-effec- 
tiveness of a program strategy includes a comparison of the 
dollar benefits to the costs through a full cost-benefit 
analysis or less complicated techry-ques such as pay-back 
analysis (P/PV, 1982) . For the two programs inspected here 
such analyses are precluded because we ljafck adequate njea-. 
sures of net program impacts or benefits ior youth by virtue 
of the absence of a comparison or control group. In Project 
Opportunity I , cost-benefit analyses are possible; however , 
such sophisticated analyses make 1 ittle sense because this 
program failed to achieve .positive impact on the labor mar- 
ket status or the earnings of program youth vis-a-vis the 
comparison group. Thus f in Project Opportunity Phase I f any 
comparison of costs to benefits would produce results in- 
dicating that the program is not cost effective and that 
youth are incapable of "paying back" the cost of the program 
through their increased earnings. 

Nevertheless f through the more basic technique of unit 
cost comparlson f we are able to gain insighJL into how the 
programs under study compare with other national ^youth pro- 
grams. In this chapter, we present a series of ur : cost 
indicators commonly u£ed in the employment and . t. aining 
field in order to gauge in a rough manner how Project Oppor- 
tunity and Open Road/New Jobs measure up to alternative 
program strategies. Cost figures for the study^rograms are 
based upon the programs' internal accounting records and 
hence are subject to some variation depending upon local 
accounting practices. Before analyzing results , method- 
ological issues and procedures are discussed. 

Methodological Issues and Procedures ' . 

While useful evaluative information results from com- 
paring unit costs % across programs/ several cautions should 
be mentioned; ; First f when dealing with new, short-term, 
demonstration ^projects, care must be taken in calculating 
even the simplest, cost figures. As previously mentioned, 
learning curves lessen the. accuracy of data aggregated over 
time . Also demonstration programs incur substantial plan- 
ning and start-up expenses as well as end of demonstration 
' (phase-out) costs. Such non-recurring costs must be culled 
out or pro-rated lest cost figures be unduly inflated. In 
addition, these programs bore certain extraordinary costs , 
particularly costs bound up with research, which are not 
part of usual ^program operations. 



In order to correct for these problems, several opera- 
tions were performed. 'First, e^ch program's fiscal year 
1980 expenses were analysed on a line item basis and resear- 
ch costs were isolated. Table 13 presents summary results. 

Table 13 

Research Costs as a Portion of Overall Expenses:PO I and OR 

Total Direct 

FY80 Costs Research Costs % Research 



PO I $101,955 $23*425 23% 

OR/NJ v $144,594 $15,730 11% 

■ >» 

Note: Costs do not include youth stipends. 

The discrepancy in the percent of research dollars 
is striking and ties primarily to research task differ- 
ences between the two programs . Project Opportunity I 
was not only responsible for gathering client data but 
was charged with the tasks of recruiting, testing, and 
interviewing a comparison group of youth* Open Road/ 
New Jobs did not have the responsibility of generating 
a comparison study group. 

Next, a "typical operating period" technique was 
used to estimate program expenditures minus research 
costs. This technique has the advantage of eliminating 
spur i'bus costs assoc iated with project start-up and 
wind-down. Hence, it is especially applicable to short 
run demonstration projects. The technique calls- for 
selecting a typical time period dur ing the mid-1 if e of 
a demonstration program and estimating unit costs from 
fiscal and participant data pertinent to this "normal" 
operating period"^ Particular care must be taken in 
defining the typical period, especially in programs 
like Open Road/New Jobs which enroll youth in cycles. 
In selecting the typical operating periods for these 
programs, spread sheets of monthly costs, monthly 
intakes and terminations, and monthly youths in process 
were analyzed (see Appendix D) . ^ 
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Unit Cost Calculations and Discussion 



Four unit costs commonly used in employment and 
training evaluations were calculated for each program. 



• average cost 
per participant 



cost per 

participant year 



cost per positive 
terminati on 



cost per unsub- 
sidized job 



(average typical month 
costs/average typical 
month caseload) x 
average length of stay. 

(average typical month 
costs/average typical 
month caseload) x 12 
months 

d 

average typical opera- 
ting period cost/num- 
ber of positive termi- 
i-ons during typical 
rating period 

average typical 
operating ;.period 
costs/number of youths 
attaining unsubsidi zed 
job at termination 
during typical opera- 
ting period 




Table 14 presents these four units costs for the 
three programs. 

! * • Table 1'4 



Unit Costs: PQ-I, PO-II, OR* 



Cost Per 
Participant 

Cost Per Parti- 
cipant Year 

Cost Per 
Positive 
Termination 



PO-I 
$ 2961 (975) 

$ 7107 (2340) 

$ 7481 (2464) 



PO-II ** 
$2020 (708) 

$6060 (2124) 
$2656 (929) 



OR 

$2804 (1005) 
$8208 (2940) 
$5792 (2080) 



Cost Per Unsub- .$10331 (3403) $3054 (1068) ,$7722 (2774) 
sidized Job 

♦Numbers in parentheses are unit costs without youth stipends . 
**P0 II research costs were computed and netted out using the Si 
percent (11%) as OR since the research tasks were o^ similar scop( 
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It is readily apparent that the second phase of the 
Project Opportunity II program is by far the least costly. 
Several factors probably contributed to this. First, re- 
stricting our focus to costs that include youth stipends, 
employers in Project Opportunity Phase II shouldered ' half of 
these stipend costs from the beginning of the fourth month 
until the end of the training. Since^training could run up 
to six months,, employer contributions could run as high as 
$1,600 per youth. In reality, the average youth remained in 
the program exactly four months; employer contributions" 
therefore covered one month or about $500 per youth. Adding 
$500 per participant back into its unit costs puts this pro- 
gram in the range of the other two programs. 

However , employer contributions do not explain Praject 
Opportunity Phase II 's superior performance in the„ are/s of 
cost per positive termination and cost per unsubsidized job. 
Even when adding the $500 employer contribution to costs per 
positive ' termination and unsubsidized job costs, the program 
is still almost 50% less expensive than £>pen Road/New Jobs 
and 75% less expensive than its progenitor, Project Oppor- 
tunity Phase I. 

Two factors may have resulted, in the greater, cost- 
effectiveness of Phase II. First, the program matured. 
Staff not only applied skills that were honed during the 
original program, but a retinue of employers who could be 
counted on as repeat customers- had developed. About half of 
the employers participating in the second phase had also 
trained youths in the earlier program. The availability of 
a core of employers meant that placement time and hence 
costs were greatly reduced relative to the Project Oppor- 
tunity Phase I and Open Road/New Jobs where placements with 
employers had to be developed from scratch. Second, the 
Phase II staffing pattern was streamlined and functioned 
with two job developers (as opposed to three in .Phase I) for 
most of its project life. 

Open Road/New Jobs markedly outperformed Project Oppor- 
tunity Phase^ I in cost per positive termination *and cost per 
unsubsidized job. There is no reason Ifo think that this 
program would not also have benefited by experience and 
continued to improve its efficiency . 

In order to interpret Table 14 data in a more meaningful 
context, it is helpful to compare these unit costs with 
those from established formula-funded programs . Unfor- 
tunately, data arfe not ^available for formula-funded costs 
per positive termination or for attainment of an unsubsi- 
dized job. Our ane ysis is limited to costs per partici- 
pant, per slot, and per participant yeaf*. Unit costs of 
this sort can be quite misleading. For example, a program 
having an extremely , high dropout and replacement rate may 
end\up with a very frugal cost per participant because the 



denominator of the calculation, total participants, swells. 
In such a -case, a low cost per participant may well be the 
result of a poorly run program. Our analysis is admittedly 
crude and seeks, only to gauge roughly whether .Project Oppor- 
tunity and Open Road/New Jobs are in the same general range 
as alternative formula-funded efforts. Table 15 presents 
the data. 



. Table 15 

Unit Cost Comparison with Other Youth Programs 1 



YET PA Transition 
Services 

Work Experience 
(Title II B,C) 

OJT (Title \1 B,C) 

PO-II 

PO-I/OR 

YCCIP 



Cost Per 
Participant 

324 

1641 

1638 
2020 
2878 
2 985 



Cost Per 
Slot 

455 

2036 

2182 
3030 
3842 



Cost Per 
Service Year 

905 

5311 

6088 
6060 
7685 . 
7793 



*Figures for formula-funded youth programs were taken from 
Taggart, 1981, pp. 25, 138. s 



If we assume* that unit costs for Project Opportunity 
Phase II are a fair rendering of. costs that the models under 
study can attain, this form of programming (subsidized 
private sector wor>k experience) certainly approximates those 
formula-funded Strategies which are most similar: OJT and 
Work Experience. However, it is important to note that 
during their start-up year, these programs cost substan- 
tially more and closely approach the rather expensive YCCIP 
programs that were characterized by labor intensive work, 
increased staff supervision, and provision of expensive 
building materials. 
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CHAP TER VIII; PRIVATE SECTOR INVOLVEMENT : 
v AN EMPLOYER ANALYSIS 

This chapter examines data from two hundred employers 
who trained youth from Project Opportunity or Open Road/New 
Jobs. In addition to describing the businesses, we explore 
such issues as: 

• why did firms agree to take on a youth? 

what effects did program participation have upon 
employers? 

• what were their views of the program and the 
youtH? 

• did the difference in subsidy level affect 
employer participation? 

• how 1 productive were the^ypuths? 

Data Collection ^ " 

Responses were collected from participating employers in 
several ways. First, each par ticipa ting ' employer was re- 
quired to fill out a briefs "Business Profile" which sought 
information on the size, age, and type, of firm as well as 
character is t ics of the work force. Secdo4, telephone sur- 
veys were conducted wi th Project Opportuni ty> Phase I and 
Open Road/New Jobs employers several months after they had 
agreed to train a youth. The telephone survey asked employ- 
ers to answer a number of questions -about the youth, the 
program services, their reasons for participating, and 
possible effects that the program had upon their hiring 
practices. In Project Opportunity Phase II, in addition to 
collecting data through letter surveys , an employer con- 
ference was held where employers not only completed stan- 
dardized questionnaires but were afforded the chance to 
discuss their views of the program wi th legislators , local 
P^iqie Sponsor representatives, and with P/PV staff. 

Response rates were adequate. Seventy of the 94 (75%) 
Project Oppor tuni ty Phase I employers completed telephone 
surveys and 70 of 110 (64%) Open Road/New ' Jobs employers 
were successful ly interviewed . Thirty- two of 41 (7 8%) 
Project Opportunity Phase 1 1 employers completed written 
questionnaires and 16 attended the employer conference. \ 

Character is t ics of the Employer Sample 

The participating firms in all three programs have much 
in' common (cf . Table 16) . They are small and averaged 
fifteen employees with Open Road/New Jobs establishments 
being especially small with an average work force of nine. 



, Table 16 

Employer Baseline Characteristics : PQ and OR • 

POI PO II OR 

n=94 n=41 n=110 



Industry 



Construction 


2 


2% 


.2 


5% • 


8 


7% 


Manufacturing 


9 


• 10% 


7 


17% 


19 - 


. 17% 


Transportation, Utilities, 


2 


2% 


1 




J- 




Gotmtunication 














Wholesale Trades 


n 
Z 


99b 


X 


2% 


# 2 


• 2% 


Retail Trades 


29 


31% 


10 


24% 


14 


13% 


Finance, Insurance, m , 


14 


15% 


3 


7% 


2 


2% 


Real Estate a 














Services 


31 ( 


33% 


17 








Other 


2 


2% 


0 




- 0 




Business Organization Type 










-> 




Sole Proprietor/Partnership 


. 47 


50% 


25 


61% 


76 


69% 


Corporation 


44 


47% 


15* 


S6% 


33 ' 


30% 


Unknown # 


"3 


• 3% 


' 1 


2% • 


"v V 


1% 


Owner Manages Company 


. 70 


74% 


35- 


85% ' 


95 


86% 


Years in Business 


Mean 


17 


21 




12 






S.D. 


24 


3 




11 




Nunjfier of Employees 


Mean 


24 


11 




9 




S.D. 


45 


12 




11 




Number of Entry Level 


Mean 


• 9 


- 5 




3 




Employees 


S.D. 


17 


8 




2 




Number of Employees 


Mean 


8 


6 




2 




Age 16-21 ^ 


S.D. 


- 16 


8 




2 




Company Has Hired from 


/. 






39% 


17 


15% 


Other Empl. & Trng. Progs- 


22 


23% 


16 



Co nroany Has Training Prog. 
tor Rntry Level Employees 



14 34% 



24 



22% 



They are predominantly^ owner ^managed and are fairly well 
established, having typically been' in business for ten to 
twenty years. In all threp programs, the typical business 
dealt in services with retail trades and manufacturing being 
wel 1 represented . Table 16 (Employer Basel ine Characteris- 
tics: PO and OR) 

On the average, about one third of the jobs in these 
businesses were entry level and one third of firms' employ- 
ees were between 16 and 21 years of age . , However , a closer 
inspection indicates that younger workers did nob systemA 
f^tically occupy the entry-level positions. Further, a large 
proportion of firms ^across both Project Opportunity and Open 
Ro^d/New Jobs reported no entry level positions (40%) and -no 
youthful employees (28%) . 

Final ly ,• four out of five firms (78%), had never hired 
youth from employment and training programs, which indicates 
that the programs are indeed tapping into a new and viable 
source of private sector training, small business. 

Why Do Firms Get Invol ved . . . and Why Not? 

As has been noted, a centerpiece of Project Opportunity 
and Open Road/New Jobs programs was a powerful set of in- 
centives designed to attract employer participation. Ac- 
cordingly, an important facet of our research plan was to 
identify tho£e features that most effectively facilitated 
employer involvement. In Pro ject , Opportuni ty Phase I and 
Open Road/New Jobs, employers were asked the question: "What 
was the main reason you hired a youth?" The major reasons 
given were two: 1) the original presentation of the job 
developer and 2) the presence of employment geared to youth 
already existing in the firm. Together the-se represent 
about 60% of responses on reasons for hiring. The obvious 
incentive, the chance for a free employee, was of less 
importance, indicated by 18% of respondents in both pro- 
grams. Community responsibility was also a minor motive 
though more a factor in Project Opportunity Phase I (20%) 
than in Open Road/New Jobs (10%) . 

To assess the efficacy of program incentives more close- 
ly, employers were asked the role which incentive program 
features played in their decision to accept- a" program youth. 
The responses, exhibited in Table 17, reveal some very 
important and interesting contrasts. The "Little Incentive" 
column reveals that the weakest motivators for accepting a 
youth had to do with working with the service agencies and 
with reduced burden * from unemployment compensation and 
wnrbpn's n nmnpn t i on . Examinina resoonses bv individual 



Table 1.7 



Degree of Incentive Prov ided by Selected Program Features 





iia Feature 


A Lot 




Some 


Little 


OR POl 


0 n 


POl 


OR POl 



ition of Agency 


10.0 


37, 


.1 


15.7 


20.0 


60.0 


31.4 


iges paid by program 


48.6 


C A 

54 , 


> 3 


30 . 0 


24. 3 


8.6 


10.0 


i paperwork - 
red tape 


50.0 


62, 


.9 


17.1 


14 . 3 


20.0 


11.4 


relationship 
\ trainee 


42.9 


40, 


.0 


34.3 


34.3 


10.0 


10.0 


i to teach 
.nee skills 


50.0 


50, 


.0 


32.9 


30.0 


4.3 


5.7 


id burden of 
iployment Compensation 


31.4 


37, 


,1 


27.1 ' 


15.7 


28.6 


34.3 


id burden of 
cmen's Compensation 


31.4 


32, 


.9 


21.4 


18.6 


34.3 


34. 


rement with Program 


22.9 


22, 


.9 


30.0 


41.4 


31.4 


17.1 


:unity to interview 
screen trainee 


22.9 


38, 


.6 


41.4 


30.0 


22.9 


15.7 


I and firing control 


31.4 


50, 


.0 


28.6 


17.1 


24.3 


17.1 



Percentages do not sum to 100 due to missing responses. 
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this reflects the fact that ADVOCA"p" is well-established .and 
well-known for its many programs in its rural and small ci'ty 
service area. Open Road/New Jobs was new to the San Fer- 
nando Valley and probably unknown to most employers. 

While overall , most features held some appeal , three 
elements were particularly influential: 

• the paucity of paperwork acwfl lack of red 
tape; Y 

• the wages being paid by the program; 

• the opportunity to teach a trainee. 

This mix of pragmatism and altruism is striking. Cer- 
tainly the importance of dollars and cents considerations 
was expected, but it does seem contrary to the responses to 
the earlier question: "What was the main reason your company 
hired a program youth?" Howevet, this earlier question was 
open-ended, and the responses do not . necessarily conflict 
since employers will not usually hire solely for the reduced 
cost of labor 1 . Savings on wages coupled with the elimina-'- 
tion of the classical employer complaint, r too much *~ed 
tape," seems to have substantial impact. The strong attrac- 
tion of the opportunity to teach a youth was not expected. 
Recall however that job developers emphasize a one-to-one, 
mentor relationship with trainees. Obviously this meant 
much to employers and represents an important component that 
deserves significant attention in future youth programming 
efforts. 

Data was not systematically gathered dn refusing employ- 
ers so it' is difficult to isolate obstacles to employer par- 
ticipation. This issue was indirectly addressed when an 
cpen-ended question was asked to participating employers 
regarding the "biggest disincentive" to participating in the 
programs*- Thirty percent of the Project Opportunity Phase I 
employer s ' and 15% of the Open Road/Mew Jobs ones felt that 
there were .io disincentives. For the employers who did 
identify disincentives, almost half in both programs cited 
that educational dof iciencies and/or a lack of maturity in 
participants was the major impediment to accepting a youth 
into training. Another quarter in each program believed 
that participants had not been properly matched to j obs . 
Interesting ly , the remaining employers for the most par t 
felt that their own fears and uncertainties were the ma j or 
impediments fear of theft and anxiety that the youth 
would quit the training. These findings reinforce the 



prime sponsors, the Job Service, and the programs in select- 
ing youths and matching them with employers. 

Analysis of Employer Outcomes 

The effect of program participation upon -employers has 
considerable consequences. For example, research has shown 
thajt if an employer has a good experience with the program, 
that employer often is willing to train additional disad- 
vantaged youths and to aid in enlisting other ^employers 1 to 
do the same (cf. P/PV, 1982). Three distinct outcome in- 
dicators were included in the employer survey: 

• increased employer effort to recruit and hire 
youths; 

•« 

• changes in company attitudes and practices 

on hiring youth; * ^X. 

• increased employer willingness to participate in' \ 
employment and training programs. * 

Most employers (about 70%) responded that the program 
had no impact "on the first two, indicators. They had not 
altered their efforts, attitud.es, or practices regarding 
youth hiring. It is possible that the lack of change along 
these dimensions has. little to do with program quality. For 
example, the results may be the result of the lack of demand 
for labor which, in turn, is dependent upon ■ business condi- 
tions or'other factors. The reader should keep in mind that 
these programs overlapped the current recession. 

Participation in these programs did appear to incline 
employers to make more use of youth employment and training 
programs. Four out of ten employers in Project Opportunity 
Phase I and a similar number in Open Road/New Jobs reported 
that they were more willing to participate in youth pro- 
grams. Comparatively 4 few (11% in Project Opportunity Phase 
I and ,20% in Open Road/Mew Jobs) indicated less willingness. 
These opinions were empirically borne out in Project Oppor- 
tunity Phase II where 20 of the 43 employees were repeat 
customers who readily agreed to train additional youths. 
The positive response towards youth training programs was, 
in all likelihood, related directly to quality of service 
delivery. As the data in Table 18 clearly show, the great 
majority of employers were satisfied with the quality x»f 
service and overwhelmingly found the job developers' visits 
and calls to be helpful and not disruptive. 



Job Creation 
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Table 18 



Employers' Views of Program Services 





PO 


I 


PO 


II 




OR 


Satisfaction 


n. • 


* 

% 


n 


% 


n 


% 


Very Satisfied 


34 


52% 


19 


61% 


26 


43% 


Satisfied 


25 


39% 


11 


36% 


30 


49% 


Dissatisfied 


6 


9% 


1 


3% 


5 


8% 




65 


100% 


31 


100% 


. 61 


110% 


Close Staff Contact 














Helpful 


56 


98% 


27 


96% 


57 


96% 


Disruptive 


1 


2% 


. . 1 


4% 


2 


4% 




57 


100% 


28 


100% 


59 


100% 






Table 19 











Work Experience Position Created for Program Youth 



n 



Yes 



n 



T 



No 



PO I 
PO II 
OR/NJ 



24 
10 
24 



38% 
31% 
40% 



10 
22 
36 



62% 
69% 
60% 



Total r 



58 



37% 



98 



63% 



position was an existing vacancy or .whether it was created 
specifically to accommodate the program youth. Table 19 
displays the number and percent of employers who created the 
position to accommodate the trainee. 

In each program, between 30% and 40% of the work exper- 
ience traineeships were created specifically for project 
youth. Admittedly these "jobs" are of short duration and 
are publicly subsidized. Therefore, although the programs 
appear to have impact in terms of traineeship creation, we 
would have to analyze Whether or not these youths were even- 
tually hired by their training employer if we' were to assess 
job creation. Unfortunately., we do not have direct evidence 
since the data do not permit us to cross-step from a tra in- 
eeship creation to hiring the youth in a full-fledged, un- 
subsidized job. 

Tabulations were analyzed to explore the degree to which 
job creation might relate to firm characteristics. No 
pattern was apparent in the response frequencies by- indus- 
try, size, owner-management, type of business, or age of 
employees. In other words, there was no reason to belike 
that whatever job creation may have existed depended »,:.. 
any of these firm characteristics. 

V 

The Wage Subsidy 

The nature and impact of wage subsidies in public em- 
ployment policy has attracted considerable attention (Pal- 
mer, 1978). Our study, though limited in scope, addre.se;; * 
number of issues concerning direct employer subsidies. 7n 
addition to ' our survey data, structured group intei^e*' 
were held with sixteen Project Opportunity Phase II en 
ers. These sources provide valuable insight - into employers' 
views about the direct subsidy for youth wages and the 
mechanism for d ispensing it . 

Participant employers unanimously agreed in their group 
interviews that the wage subsidy was key in their agreeing 
to train yd' w :i because it diminished their risking the time 
and money ir /olved in training an entry-level employee . The 
wage subsidy was perceived as a reimbursement for the train- 
ing. . As one employer put it: "Training time costs a for- 
tune.. The juosidy fron'r was very important." 

In addition to the subsidy's positive effect in terms of 
attracting employers, an equally critical finding that 
emerged froir the group interviews was, that employers all 
agreed ",the 100% subsidy bought tolerance. 11 Employers 
contended that the subsidy enabled them to go to extra 



population lacking in job readiness. Given that five otr 
ten Project .Opportunity Phase I and. Open Road/New ; r ^bs 
employers who completed the phone survey (n = 14 2) bel iv, /ed 
that program youth required more supervision than the usual 
entry level employer, "going the extra mile" with a youth 
could indeed make the difference between failure and ^ac- 
cess. While the disposition of individual employers and the 
work,, of the job developer certainly influenced the eiu? J. oy- 
er's "tolerance," the' wage subsidy also seemed to ha<*e a 
major impact. 

In terms of varying the subsidy, employers hr>d ^ixed 
opinions. A myriad of var ia tions . were advanced such af "75% 
for two months then 50%;" "make itj^depend on the in:'r ? idnal, 
'til you know if the youth is really into it."- However., we 
did learn that the original 100% wage subsidy, that Project 
Opportunity Phase I and Open Road/New Jobs offered c* ild Lf* 
reduced after several months of training to the 50% levc-i 
with no apparent negative effects* In fact, employers fe.^ u . 
this was attractive for two reasons-, First, since most of 
the training and most .of the non-positive terminations occur 
within. the first several months, the full subsidy for this 
initial period adequately compensated for employer rirk. 
Second, by paying a portion of the youth's salary,, responsi- 
bility to the business as opposed to the program we? ft driven 
home* While lauding the fact that -the program henciled all 
of the paperwork, several employers felt that thu.r> contrib- 
uted to youth perceiving themselves as pr incipal iy accoun- 
table t9 the programs , not the employer ♦ Fur the*. , with re- 
spect to the 50% employer buy-in after three months, exam- 
ination of termination d'ata allayed the fear that employers 
would jettison youth when the 100% isubsidy ran out. Both 
the quantitative and the interview data indicate that em- 
ployers were willing to invest in training ^ia thei,r 50% 
wage payment after the full subsidy period was exhausted . 

On the procedural leve? , collecting the employer 1 s share 
did not prove to be a problem. Project Opportunity Phase II 
continued to collect the youths 1 time sheeLs from employers 
every week and to pay the youths directly. Then, on a 
monthly basis employers were billed for theiv portion of the 
costs . Billing to emp] oyers averaged over $3, 600 per month 
and invoices were generally paid promptly. Total employer 
billing for Project Opportunity Phase II tallied $23,116 and 
only 4% ($853) Went uncollected. All in all, sharing the 
youths'^ wages appeared quite workable from the employers 1 
perspective. 

In ord*r to investigate the degree that the subsidy 
offset tr^r.ning costs, we included an item in our employer 



Table 20 



Employer Opin ion of Program Investment 



Saved Money 
Lost Money 
Broke 'Even 
Total 

Responses are subjective and are based on general per-^^ 
cept ions not precise accounting data . Nonetheless , it is 
puzzling that Project Opportunity Phase II, where the actual 
dollar value of the subsidy decreased because of the employ- 
er matchi, evidenced the smallest percent of employers who 
felt they had "lost money on the program." Perhaps this is 
attributable* to the higher caliber of youth that program 
staff f^lt enrolled in the second phase. Over half . the 
Project/Opportunity employers in each phase felt that income 
from tWe wage .subsidy more than equalled costs involved in 
training the youth'. In Open Road/New Jobs, the, employers 
were /equally distributed' across the three categories which 
supports the process evaluation's suggestion that the Open 
Road/New Jobs participants may have been less ready for a 
work experience, 

\ 

Produc t ivit y < , 

<i 

To assess the productivity of trainees, employers were 
asked "how well program youths performed in comparison with 
the typical entry level employee." Almost half of 142 Open 
Road/Ner Jobs and Project Opportunity Phase f employers 
believed that program youths performed .below the level of 
their typical . entry level employees. Less than one in ten 
rated the trainee's productivity higher than a typical 
employee. Interestingly, overall business activity for some 
participating firms was reported to increase during the 
period of program participation even though trainees were 
not as individually productive as typical employees. The 
data does not permit us to conclude that the business pro- 
ductivity noted by over half the Project Opportunity Phase I 
and Open Road/New Jobs firms is directly related to program 
participation. However, anecdotal evidence suggests that in 
very small establishments %ho could not afford to hire ad- 
ditional employees the trainees' presence freed up owners to 
engage in a greater degree of business development activi- 
ties. 



PO I 



n 


% 


34 


59% 


15 


26% 


9 


15% 


58 


100% 



PO II 



n 


%. 


16 


52% 


5 


16% 


10 


32% 


31 


100% 



n 


% 


20 


34% 


20 


34% 


» 19 


32% 


' 5 9 


100% 



In summary, employers look upon these programs very 
favorably. In spite of the fact that many trainees did not 
perform as well as typical entry level employees, employers 
may have exercised more tolerance* with these youth due to 
the fiscal subsidy and the help of the job developer . The 
subsidy, the lack of paperwork, and the opportunity to teach 
a trainee appeared to be most powerful incentives to employ- 
er participation. Employers pointed out that the immaturity 
and educational deficiencies of participants were the major 
problems. In terms of program impact, the data hints that 
the programs have modest job creation effects. The programs 
appear to be tapping an underutilized employment and train- 
ing resource,' the small business sector , and to enjoy some 
success in motivating employers to make greater use of pub- 
lic employment and training programs. 
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CHAPTER ijii SUMMARY OF FINDINGS 
*AND RECOMMENDATIONS 



This chapter presents our key findings relative to 
Project Opportunity and Open Road/New Jobs . In add it ion to 
summar i zing pol icy relevant results , suggestions useful to 
program planners and practitioners are set forth. 

Pol icy Impl icat ions 



From a policy perspective, . the major questions concern- 
ing' the use of wage subsidies are: 



Given the limited number of ■ the programs, we must be 
cajutious in drawing inferences; however, the answer to the 
first question appears to be yes. Less than one in ten of 
the employers were dissatisfied with program services, and 
employers were especially pleased with three program fea- 
tures: 

• the absence of paperwork and red tape that 
resulted from the programs ' handl ing youth pay- 
roll and other administrative duties. 

e the opportunity to^ teach a trainee 

• the wage subsidy. 

While the role of job developer was critical to employer 
involvement', the subsidy also appeared to heighten involve- 
ment. Not only did employers perceive the subsidy as dimi- 
nishing the costs, and risks in training youth; but anecdotal 
evidence indicates that the subs idy "bought tolerance, " 
motivating employers to go to extra lengths in working 
through trainee problems. In terms of the exact rate of 
subsidy, employers'* views were not consistent. But, the 
Project Opportun ity 1 1 experience testi f ies that after 
several months of a full 100% wage subsidy which Offset the 
risks to the employer, employers were ready and willing to 
shoulder half of the youth wages for the remaining months of 
the work experience placement. x In terms of the impact upon 
employer s , the programs appeared to incline a sizeable 
portion (40%) of employers to participate more in employment 



• do employers respond to this type of program- 
ming? " c " " 



9 s do the youth improve their labor market status? 



7 




.thy because about half the employers believed that program 
youths performed below the level of typical entry-level 
workers. Finally, almost 80% of the employers had never 
hired a youth from an employment and training program which- 
indicates that this form of program intervention is .capable 
of tapping a new and viable source of private .sector trai- 
ning, small businesses. 

But, do the programs improve the subsequent earnings of 
youth? Available data are negative, ' but limited to a single 
program, Project Opportunity Phase I, where there wa's no 
post-program earnings impact. Both of the other programs 
(Open Road/New Jobs and Project Opportunity Phase II) which 
were not followed-up as a result of cost consideration, 
clearly outperformed Project Opportunity Phase I on con- 
ditional measures of performance obtained at termination and 
cost measures. It is possible that these two programs 
significantly improved participants' job prospects, but 
there are no data to- test; this speculation. 

On other indicators, the programs fared better. When 
compared to selected youth training programs, Project Op- 
portunity II and Open Road/New Jobs appear to be on an equal 
or better performance level. Their combined jpb placement 
rate at termination more than doubled that of the 1980 
national YETP programs (19%) and almost equalled—the place- 
ment rate of adult work experience programs. In terms, of 
cost, the programs were more expensive than comparable 
efforts during their start-up year; but assuming that the 
better established Project Opportunity Phase II is. a fair 
reading of costs that these .models can attain, they approxi- 
mate those formula-funded programs which are most similar: 
OJT and Work Experience. ytfe stress that both the termi- 
nation and cost; findings are imperfect estimators at best; 
Differing program objectives and the lack of more meaningful 
cost indicators greatly inhibits inter-program comparison. 

In summary, the viability of the subsidy mechanism and 
the responses of small businesses were encouraging; but,; 
until more broad-based researc;: is undertaken, it remains to 
be seen whether this mechanism can contribute to long term 
employabil ity of disadvantaged y;uth. 

Program Re f inements 

In spite 'of their generally successful operation, each 
program could have refined its de^iijn. Twenty percent of 
employers interviewed felt that the ' .youth* could have, been 
better matched in the tra in ing placement . In Project Op- 
port uni ty , matching may have been improved had there been a 



would have done well to eliminate its cyclical enrollment 
system. Enrolling youth in two major waves of si^ty taxed 
Open Road sta f f and may have contr i butted to sob- opt imal 
matches of youth with employers. A continuous intake system 
with concentrated, bi-weekly pre-employment workshops for 
new enrollees would" have better distributed the 4 Open Road/ 
New Jobs work load without significantly detracting from the 
job training.. In addition, the usefulness of the Open 
Road/New Jobs job bank was questionable. Various^ reasons, 
cited earlier< in the report, resulted in comparatively few 
youths (25%) entering job bank placements. The substantial 
amount of time devoted to assembling the job bank commit-* 
ments — coupled with the bank's underutilization — made it 
a doubtful program feature. - 

Neither program performed well in facilitating program 
youths' earning a GED. This appears to be a prevalent, pro- 
blem in employment and training programs and warrants closer 
scrutiny. Another widespread difficulty which was encoun- ^ 
tered in these programs involved the screening and selection 
process. Open Road/New Jobs staff believed that the screen- 
ing, performed by the Job Service, was not sufficiently 
comprehensive and resulted in the referral of a high pro*- 
portion of youths who were not prepared for the demands of 
the private sector work experience. On the other hand, 
Project Opportunity staff felt that its local Job Service 
spent entirely too much time in , certifying and screening 
which frustrated many youths/ causing premature withdrawal 
from the application process. Staff in both programs sus- 
pected that the Job Service catered to established programs 
as opposed to new,, time-bound demonstration efforts. and, in 
Project Opportunity, it v;a.s felt that the type of youth 
referred from the Job Sev ice' varied according to local 
economic conditions. In combination with similar findings, 
in other P/PV demonstration projects , these observations 
call into question the precision of the certification, 
screen ing , and program referral process in general . Closer 
scrutiny of the CETA eligibility determination and referral 
process appears warranted. 



PART II; 

OCCUPATIONAL ACCESSING STRATEGIES 



As mentioned in the introductory chapter, occupational 
training programs have been ^a ".prominent service offering 
sinc6 the early 1960's. Initially, skills training programs 
were est ab 1 i shed to meet the need for "skills retrain ing" 
among experienced members of the workforce suffeririq high 
unemployment. Since then, the target population of jskills 
trainirfg programs has expanded to include large proportions 
of disadvantaged trainees. Generally, results have been* 
positive with skills training programs having significant 
impacts on the post-program earnings of enrollees (cf . Perry 
et al, 1975). Nevertheless, little is known about" the 
effects of skills training on a younger population, and many 
believe \hat youth have not "settled down" sufficiently to 
commitNbhernselves to a specific occupation. Further, review 
of the skills training literature suggests that: 

Training produces earnings gains without 
achieving substantial occupational 'mobility 
for more than a small minority .'of partici- 
pants . "Quantum leaps" into new careers , * 
are achieved by few. (Taggarfc, p. 120) ' 

Theoretically, "quantum leaps into new careers" jnight 
occur via carefully crafted programs that are capable of 
supplying trained workers either: 

• in occupations- where severe' skills shortages are 
present; or, 

• in emerging occupations that promise extensive* 
job opportunities . 

In both si tuations , the successful prog ram must couple the 
presence of demand with the absence of structural barriers 
such as established legal or induction- requirements that 
would be d i f f icult hurdles for out-of -school , d i sad van t aged 
youths. Two programs were initiated by P/PV in late 1979 to 
. test whether planned occupational access ing strateg ies that 
address local employment needs would work fo'r youth: 

9 Machine Trades Training Program for Youth 

(MTTPY^ . operated bv Cuvahoaa Community College 



• Career Pathways in Energy Conservation 

(CPEC) , operated in Boston by the Technical 
Development Corporation (TDC) • 



In reporting our findings regarding these two programs, 
we follow a schema that parallels Part I. First, in Chapter 
X, the MTTPY and CPEC programs are described in their ideal, 
as envisioned by their planners. Next, Chapter XI, "The 
Models in Action," depicts how each program functioned dur- 
ing its year of operation. Chapters XII and XIII examine 
youth termination status and cost-effectiveness respective- 
ly. As noted, no post-program follow-up was undertaken with, 
MTTPY or CPEC. Therefore, we summarize findings and recom-' 
mendat ions in the concl ud ing chapter . 

X 



CHAPTER X: THE MODELS IN THEORY: 



MTTPY AND CPEC 



Both models were created de novo for this demonstration. 
Al though independently planned , they were remarkably simi- 
lar. The design o,f each program featured a selective 
screening process and a. fairly similar set of programmatic 
components which are charted in Figure II. 

Figure II 

Service Components: MTTPY and CPEC 

MTTPY CPEC 

\ 

Screen ing & In take x x 

x 

x x 

X X 

On -Job Training (OJT) x x 

Unsubsidized Job Placement x x 



\ 




Diagnostic & Career Prep 
Classroom Training 
On-Site Work Experience 



Each progr; relied on its respective Prime Sponsors to 
recruit, screen and refer youth. Because of the highly 
skilled nature of the training, the prime sponsors agreec to 
refer youth who had mastered the basics in reading and ma :h- 
emat ics . Youth were recru i ted in success ive waves o. cycles 
as opposed to continuous intake . 

r 

MTTPY 

".TTPY concentrated on training disadvantaged youth for 
the machine trades, a field which was experiencing acute 
problems in attracting skilled workers. Following accep- 
tance into the program, pan* ticipants spent over a month in a 
Diagnostic and Career Prep phase. For a few youth, this 
component served as a secondary screen ing net , and a f ter 
closer exposure to the machine trades, they were referred to 
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other programs more in keeping with their skills and inte- 
rests. For most youth f this "prep" was just what the title 
demotes — a preparatory education for the machine trades . 
Featuring a programmed learn ing system, students worked 
their way through basic math and shop skills* 

Having learned the basics, MTTPY youth progressed to an 
Applied Skills Training phase that ran for over two months. 
Instruction took the form of actual work on machines com T 
bined with continuous classroom instruction. Nex t f youth 
advanced to a stage termed Transitional Employment Services. 
This subsidized work experience called for each participant 
to spend 2.5 weeks with a private sector employer to sample 
what work in the trades really entailed • 

Post-transition, the empl9yer was encouraged to enter 
into a traditional OJT contract which could run up to 26 
weeks f at the end of which time- it was expected that the 
employer would hire the* youth. j 

s 

MTTPY has at times 'beenS3ubbed both a "sponsorship" and 
a "spur" model. The former term applied to the program's 
emphasis that during the -last ..week of "prep," youth would be 
introduced to a specific employer who would "adopt" the 
trainee. 'This nonbinding agreement called for employers to 
follow . the youth ' s classroom progress and provide the se- 
quence of Transitional Employment, OJT, job. The "spue" 
model was meant to conndte that, after the "prep" component 
the MTTPY program could have several exit points. For 
example, it was quite acceptable for youth to move into an 
unsubsidized job without participating in the intervening 
phases of training. 

CPEC 

CPEC did not have a formal preparatory phase. Youth 
moved directly i.vito a two month classroom experience that 
offered both theoretical and applied learning. Also adopt- 
ing a sponsor approach, classroom training was followed by a 
ten week phase which was split evenly between work exper- 
ience and advanced in- classroom education. Similar to 
MTTPY, an OJT contract capped the training sequence. 

Both programs offered job' placement services for youth 
who wete not absorbed into unsubsidized jobs at the end of 
their program inyolvemen t . In terms of magnitude both 
programs planned to- serve about 100 youth per year at a cost 
of about $800,000 per program. 
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CHAPTER XI; THE MODELS IN ACTION 

Machine Trades Training Program for Youth (M^TPY) 

MTTPY was administered by the Cuyahoga Icommunity Col- 
lege. The college, founded in 1963, servJs metropolitan 
Cleveland, with its population of 1.5 mill ijn. Offering a 
two-year associate degree, ^khe College enrolls almost 25,000 
students and is one c.f --Ohio ' s largest educational institu- 
tions. , Career and t&-./hnical offerings feature specialized 
instruction in more than f i f ty occupational fields . Over 
the years , the College has worked closely with local offi- 
cials on a number of urban problems including employment and 
training. Both the printe sponsor and the qollege are under 
the executive authority of the Cuy&hoga County Commissioners 
and this arrangement f aci 1 i fates close working relation- 
ships. ^ , - 

In terms of this demonstration, the college entered the 
planning almost a year after negotiat ions ; had begun. This 
was because earlier efforts had run into a number of obsta- 
cles. In fact, during February -1979, after months of plan- 
ning, the project appeared stymied, ^ithin a comparatively 
brief time, college personnel were abf^ to plan the program, 
mobilize resources, negotiate the -contract, and beg in 
operations in the Fall of 1979. 

The goal of MTTPY was to al levia te a manpower crisis 
faced by the Cleveland area's- machine trades industry. 
Cleveland, acknowledged as a world Center for the machine 
tool industry, boasts several hundred firms employing thou- 
sands of skilled machinists. In 1977, there was concern 
because of a diminishing availability of skilled labor. As 
one source noted : "The sons were not taking up- the tools of 
their ' fathers . " Long-term projections increased this con- 
cern since hundreds of workers were scheduled to retire 
during the late 1970's and early 1980's. Although a half 
dozen scattered programs, ranging in form from higtf school 
vocational education to propr ie tary curricula, offered some 
form of nachine trades training, they differed widely in 
level an J duration of skill training and were judged insuf- 
ficient :o offset the shortage. In brief, local officials 
judged lat the area lacked an effective system for skill 
trainin^ and induction in be the machine occupations . 

At the same time, the youth unemployment level in Cleve- 
land had risen to approximately 40% and was especially acute 
among poo' , inner city youth. A match betwe-sn the supply of 
unempl >yeu youth and the demand for en try- level machinists 
in the form of an intensive training program made impl ic.i t 
sense. 
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Recruiting and Screening: MTTPY 

The program sought to train 126. youth during the first 
year of operation . All youth in addition to being at of 
school and meeting other CETA requirements were to be at 
least 17 years and nine months of age at intake. The reason 
for this is that upon completion of training they would be 
18 years old, the minimum age in Ohio for operating power 
equipment. Eligible youth were to be referred to the pro- 
gram from the local pr ime sponsor whose assessment process 
included extensive occupational testing. 

MTTPY did not experience problems in recruiting suf- 
' ficient youth. In fact, after the first promotional ses- 
sion, 30 0 students from the Co 11 eg e itself appl ied for 
program admission (only four proved CETA eligible,). In 
retrospect, several factors contributed to MTTPY 1 s success- 
ful enl istment of youth. First, Cleveland 's Prime Sponsor 
and Employment Service enjoyed a strong working relationship 
that has been viewed as exemplary vithin tb^ youth employ- 
ment world. Second, the program's start-up was ushered by a 
concerted publ icity campaign that encompr ssed extensive 
coverage by the 1 oc'al • media . The highlight was a televised 
press conference where the Mayor and College President dis- 
cussed the new program. Third, as mentioned, there was a 
large pool of unemployed youth from which candiuates could 
be drawn. y' 

Some problems were experienced in terms of the quality 
of applicants.. In spite of -a cooperating agreement with the 
prime sponsor tc refer; candidates demonstrating at least 
seventh grade reading and math ability, about a third fell 
below this level. However, a self-paced competency curric- 
ulum combined with individual tutoring enabled practically 
every student to obtain acceptable cut-off scores which 
qualified them to move from the initial Diagnostic and 
Career Prep stage to the Applied Skill Training module. 
Overall, -Pintake went as planned with approximately twenty- 
five youth being enrolled for each of six cycles. The 
cycles were timed so that a new wave would enter every five 
weeks with the last group matriculating in June x>f 1980. 

Parti cipant Characteristics: MTTPY 

The program sought to enlist older youth who would not 
face -legal barriers' or age biases once tney were ready for 
full-time machinist work. Of 121 enrollees, 98% wer? eight- 
een at the time of intake* with more than half of the youth 
being twenty or twenty-one years* of age (see Table 21). 
Over eighty percent of the participants were black and a 
similar proportion were male. The group was evenly divided 
* between high school drop-outs and graduates with almost one 
in ten youth having -'received' some post-secondary education. 
As noted, a third of the you thread at a less than seventh 



Table 21 



Distribution of Participant Characteristics at Intake; KTTPY* 

MTlr-Y 

Characteristics • • % 



(n = 121) 



1. Age 



16 and under 



20 



Mean 
S.D. 

2. Sex 

Male 
Female 

3. Ethnic Group 

White 
Black 
Hispanic 

4. Family Status 



36 



Family of One 

5. Number of Dependents 

zero 
1 

More than 1 . 

Mean 

S.D. 

6. Educational Grade Completed 

Less than 9 
9 

1°, 
11* 

High School/GED ' * 
Post Secondary 

NOTE: Percentages do not sum to 100 due to missing responses. 



0% 



17 2 2% 

18 28 ?3% 

19 25 ?1% 



21 29 U-i 



19.4 



102 84% 
19 16% 



14 12% 



Black *9 32% 

8 -7% 



Head of Household 13 ^ 

Member of Family 77 65% 



29 24% 



96 79% 
17 14% 
8 ' 7% 

.27 

.58 



1 1% 

5 . 4% 

14 ' 12% 

40 ' -33% 

47 39% 

11 9% 



88 

76 



Table 21 (continued) 



Distribution of Participant Characteristics at Intake: 

MTTPY 



MTTPY 



Characteristics 



7. ABLE Reading Score (Grade Level) 



i 7. 



3 - 4.9 , 
5 - 6.9 
7 - 8.9 
9 

Mean 
S.D. 



8. Ever Enrolled in Training Program 



Yes 
No 



9 . Ever Held Full or Part-time Job 



Yes 
No 

10. Job Holders Who Worked During 
12 Months Prior 

T 'es 
No 

11. Hourly Wage of Last Job Ever Held 

Mean 
S.D. 



Hourly Wage of Last Job Within 
12 Month s 

Mean 
S.D. 



13. Hours Worked per Week on Last Job 
Ever Held 

— — — ~ — * 

Mean 
S.D. 



n 



% 



(n r. 121) 



11 
30 
36 
42 



7.39 
1.75 



65 
56 



96 
25 



74 
22 



$ 3.43 
.88 



$ 3.45 
.80 



36.6 
8.9 



9% 
25% 
30% 
35% 



54% 
46% 



79 \ 
21% 



77% 
?3% 



14, - Hours Worked per Week on Last Job 
Within 12 Months 

Mean 

< S.D. • 



38.1 
8.6 



77 



grade level; however another thi-rd (35%) achieved the high- 
est test grade, reading at a ninth grade or higher level. 
The mean reading level was at the 7.4 grade equivalency. In 
terms of family status , the ma j or ity were members of f ami- 
lies (65%) and 11% were family heads; 24% were families of 
one. Two out of ten youths claimed dependents • 

In terms of work history, more than half the youth (54%) 
had been enrolled in prior training and 79% had held pre- 
vious jobs. More than three quarters of these jobs were 
within the calendar year preceding the youth's intake into 
MTTPY * Previous jobs were for the most part full-time, with 
the average hourly wage being $3.43. Overall, the MTTPY 
cohort was better qualified than most youth served by fed- 
eral employment programs and appeared to possess the ba£ic 
experience and apt i tude ^ required to successfully complete 
the fairly technical training sequence. 

Diagnostic and Career Prep: MTTPY 

Once accepted into the program , each youth cohort began 
the four to six week preparatory classroom exper ience whose 
aim was to develop basic shop skills in such areas $s frac- 
cions, decimals, use of gauges and instruments. ^ A lock-step 
competency curriculum was used and each par tic i pant was 
required to score 80% proficiency before moving to the next 
element.. Data on twenty-three Cycle I youth attest to the 
efficacy of this learning system. Pre-test scores in shop 
ma^h averaged 26% while the mean for post-training re-tests 
was 92% . 

Id addition to cognitive work, the prepatory phase 
accented career paths within the machine trades by means of 
a lecture series featuring machinists (including female and 
ethnic minority members) , union leaders, and management 
personnel. Some job readiness training, such as completing 
a job application, was also offered. Finally career coun- 
seling which utilized aptitude and ability tests was con- 
ducted with a few youth who did not appear well-matched to 
the machine trades. On the average 2.5 youth per cycle did 
not complete the preparatory phase and were, in most cases, 
referred for other training. 

Applied Skill Training Phase: 'MTTPY 

The majority of youth (87%) successfully entered this 
second phase , having achieved required competency scores in 
their shop sequence. During the Applied Skill Trainings- 
part of the day was devoted to. classroom work, but the bulk 
of instruction consisted of hands-on training at a local 
skill center. Trainees began by producing basic products 
(e.g., a corrugated metal blocrk, an all metal hammer) which 
requi red bluepr int reading , machine set up, and operating 
several machine" 7 including lathes, threaders, and grinders; 
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Staff encountered .some typical problems with *'outh - 
(e.g., lateness and absenteeism) and some unusual ones. For 
example, an apprentice could start at $9.00 per hour which 
was far above the experiences and hopes of many youth; 
instructors reported that one of their challenges was to 
convince youth that they could indeed attain these wages. 

Information derived from competence testing and eval- 
uator visits suggests that this phase was effective in 
instilling sound' work habits and developing strong, basic 
machine trade skills. Perhaps the most distinctive finding 
is that 92% of the youth successfully completed this ten 
week basic training phase. Although much of this success 
seems attributable to quality planning, the caliber of ;the 
instructors was judged to be a pr imary i rig red ient . The 
majority of instructors for both the prepartory and applied 
training were retired union machinists who knew their trade, 
could teach it, and were apparently able to convey a sense 
of discipline. In addition to teaching, instructors kept 
careful records of trainee performance and toward the end of 
the skill training phase, these accomplishments were wov,en 
into letters of reference and resume material.' The instruc- 
tors all had contacts in local firms and this informal sys- 
tem proved helpful in placing trainees in further work site 
training and in unsubsidized jobs. 

During the prepatory stage the trainee was paid a mini- 
mum wage stipend which was embell ished by incentive ; raises 
in the ski 11 training stage. 

Transitional Work Experience; MTTPY 

Upon successful completion of the skills training cur- 
riculum, the trainee progressed to an activity that dis- 
tinguished the MTTPY program, transitional work experien.:^. 
This program component consisted of placing youth in actual 
work settings for 100 to 110 hours of on-site work exper- 
ience. This comparatively brief subsidized work experience 
was designed to give youth a real taste of the work world, 
and employers a preview of individual youth's capacities. 

Employer sponsors were recruited by MTTPY' s job develo- 
per early-on and, at the end of the "prep" stage, they were 
given the opportunity to interview - and accept or reject - 
a particular trainee. Sponsors were kept appraised of their 
trainees' progress during the Applied Sk ; lis Training period 
and before the youth started with the employer a formal 
written compact was signed. The compact specified that the 
sponsor ing : employer would provide the youth wi th a work op- 
portunity that "shall have a minimum duration of 100 hours, 
for which CETA allowances will be paid to the trainee." The 
compact further noted that the objective of this Transi- 
tional Work Experience was "to provide a successful trainee 
with regular industry employment following training" but 
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that the agreement did not require the employer to "guaran- 
tee employment." Employers were encouraged to record spe- 
cific deficiencies in a trainee's performance so that these 
might be corrected through a brief return to the skills 
center , or perhaps a talk wi th a staff member. 

Only about half of . the youth who completed the skill 
training phase enrolled in Transition Work Ex per ience. Some 
youth skipped this stage to take OJT or unsubsidized jobs, 
while others simply dropped out. However, our data do not 
permit an eKact breakdown on the employment status of youth 
who did not enter the Transitional Work Experience. Anec- 
dotal evidence indicates that sufficient employers were re- 
cruited and that the sponsorship component, wherein employ- 
ers were kept abreast of their youth's progress, was an 
effective way of maintaining employer involvement. 

OJT Phase: MTTPY J f 

Employers who offered transitional work experience were 
encouraged to continue the youth's placement 6y means of a 
formal OJT agreement (or to hire the youth directly) . The 
OJT arrangement, facilitated' by program staff, provided up 
to 26 weeks of on-the-job experience. A contract between 
the Cleveland Prime Sponsor and the individual employer 
permitted half the wages to be reimbursed by the Prime 
Sponsor who originally set aside 90 OJT slots for the MTTPY 
- program . The arrangement ran rather well for the first two 
cycles. Fifteen of the seventeen youth who completed the 
transition phase continued to work upder OJT contracts. 

At, the end of 1979, the program encountered grave prob- 
lems. Massive layoffs in the automotive industry left 
Cleveland with 30, 000 idle workers-.' Over 50% of the machine 
trades employment was allied to the automotive industry. 
Monthly progress reports from MTTPY to P/PV during the early 
months of 1980 repeatedly noted: "Recession continues to 
diminish participant placement prospects." Where there had 
been a skill shortage, abruptly there was a skill surplus. 
As well , the Pr ime Sponsor delayed in honor ing bills from 
OJT employers and the program was hesitant to draft new OJT 
pacts. Whereas 60%.\o£ the participants from Cycles I and II 
had garnered {post-program* jobs in the machine trades, only 
20 of 74 enrollees (27%) in Cycles III through V attained 
jobs of any sort. 

The program design was revamped^ and instead of'continu- 
ing to enroll new youth, the final sixth Cycle re-enrolled 
28 out-of-work participants from previous cycles in a 
stepped-up training sequence. Staff hoped that by. signifi- 
cantly augmenting their skill levels, .youth could better 
compete for .available jobs/" This strategy experienced mode- 
• r-jate success. Two thirds of the youth were positively 
terminated with ten of these securing machinist positions. 

80 ' * 



Job Search Assistance : MTTPY 



This final program component consisted of program staff 
serving as job placement specialists for program completers 
who were not absorbed by OJT employers-. As conceived , only 
one ih four participants would require* these services since^ 
most would have , attained employment via their sponsoring 
employer. A .six week limit per youth was allotted for this 
service which sought to tap the Ohio Bureau of Employment 
Services as well as businesses directly in order to secure 
jobs for graduates. In reality, the number of youth who 
completed the program Without attaining placement' far ex- 
ceeded planning projections and 'the job placement function 
assumed unforeseen import . 

Career Pathways in Energy Conservation (CPEC) 

This program which sought to train and place youth in 
the energy conservation field was managed by the Boston- 
based Technical Development Corporation (TDC) . Founded in 
1969 as a non-profit corporation, TDC 1 s speciality had; been 
developing and spinning off innovative programs particularly 
in the fields of employment and training, economic develop- 
ment, and energy. During the mid-seventies, TDC was active 
in program design and research projects that dealt with 
solar energy devices, energy conservation, and a curriculum 
for energy education training. A particularly important 
undertaking was a 1977 job market study of opportunities for 
energy conservation technicians which optimistically pre- 
dicted abundant job openings in this emerging field, identi- 
fied placement potential with particular firms, and sketched 
career ladder prospects. The study was performed as part of 
a training venture that ECON, Inc., a private energy con- 
servation f irm , was packag ing for the Boston Pr ime Sponsor 
and supported ECON 's belief that there was a demand for 
trained workers in the energy field. ECON's original empha- 
sis was training for economically . disadvantaged adults; but, 
after TDC met several times with P/PV during 1978, it was 
agreed' that a youth training effort alsd" had merit and in 
the Fall of 1979 the CPEC program began. 

The goal of CPEC was to place 100 out-of -school , disad- 
vantaged youth in entry-level positions with energy related 
employees. Youth were to be trained in two waves of fifty 
each. Each group of 50 was equally divided between two 
service areas: Boston and the "Border Region," a section of 
the Merrimack Valley encompassing the Lowell-Lawrence, 
Massachusetts area and Hillsboro Country, New Hamphire. * 

Unlike MTTPY which featured a single delivery agency, 
'.TBC elected to enter into a series . of subcontracts, each 
addressing specific functions of -the program. Figure III 
depicts this arrangement.. 



Figure III 



CPEC Service Delivery Flow 
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in Boston. 



Boston 
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Prime Sponsor 
Recruit, certify, 
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CJT contracts . 
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and in-program 
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Subcontract Amt. $80,000 



Border Region Alliance ' (BRA) 
Publicize and promote. the 
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recruiting; local, link 
on behalf of TDC among 
all program components 
Subcontract Amt- $30,000 



Wescorp 

Provide training ; 
in-program and ' 
follow-up counseling 
Subcontract Amt . $60,000 
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Recruitment and Screening: CPEC 

CPEC began its first training cycle in October 1979 with 
48 of its planned 50 youth, but the recruitment road was a 
rough one, especially in the Border Region where only 19 
youth were enrolled. This shortfall was surprising given 
ample lead time (recruitment began in July) and a substan- 
tial number of reportedly unemployed youth. TDC staff 
argued ^hat neither the) Border Region Alliance (BRA) nor the 
prime sponsors held up their end of the bargair. BRA ' a 
non-profit spin-off from the National jAlliance of Business, 
had been contracted to publicize the program and aid in 
screening appl icants . - .The, local prime sponsors claimed that 
unemployment was down and that it had to cater to estab- 
lished programs who were having enrollment problems. j In an 
effort to shore up the shortfall , several extra participants 
weta recruited in Boston. 

In spite of plans, negotiations, and promises, Cycle II 
recruitment fared even worse'. The "Border Region did not 
improve its volume 'and, in Boston, there was slippage. TDC 
staff conjectured that in Boston "youth were being maneu- 
vered into 'Vet' programs." It became "so bad that if you 
sent a youth over there (to the Boston Prime) you'd never 
see them again." P'art of the Boston problem came from a 
mid-stream switch that tightened 'eligibility cr iter ia : Cycle 
I youth could qualify by meeting legislative criteria set 
forth in Title II-D, but the tables were turned when the 
Prime Sponsor ruled that Cycle II yojjth had -o meet all 
criteria from three distinct titles because funding for 
various CPEC components came from Titles II-B and VI as well 
as II-D. In the end, the program fell about 10% short of 
its projected one hundred enrollees. ./ 

Participant Characteristics: CP^ C 

Table- 22 presents demographic and socio-economic data 
for the CPEC youth. For reasons similar to MTTPY, (e.g., 
working age regulations), CPEC concentrated on older youth. 
About half the CPEC youth were twenty or twenty-one years 
old at intake with only four young persons at the 16-17 age 
interval. Average age at ei/try was 19.4 years*. The typical 
enrollee was white (64%) and male (79%) still living with 
> his family (62%). Only five of the eighty-seven youth 
claimed dependents. * * 

CPEC did not offer a formal diagnostic and preparation 
component 1 ike MTTPY ; rather, CPEC rel ied upon local Prime 
Sponsor systems to sb^eerr appropr iate candidates . Instruc- 
tors r however , voiced deep concern over the poor quality of 
participants' basic math and reading skills. Interest \ngly, 
our data do not support the program instructors' contention 
that CPEC youth were poorly educated. For example, ABLE 
reading scores were collected on half the CPEC youth (n-58) . 
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Table 22 

Distribution of Participant Characteristics at Intake: 



Characteristics 



CPEC 



n- 



(n = 87) 



Age 

16 and under 

17 • 
13 
1<9 
20 
21 

Mean 
S.D. 



1 

3 
19 
22 
19 

23 



1% 
3% 
22% 
25% 
22% 
26% 



19.4 
1.25 



2. Sex 



Male 
Female 



68 
19 



78% 
22% 



Ethnic Group" 

White 
Black 
Hispanic 
Other 



56 
21 

-7 
/ 

f 

3 



64% 
24% 
8% 
3% 



°4. Family Status 

Head, of Household 
Member "of Family. 
Family of One 

5. Number of Dependents 

zero ' 
1 

More than 1 
Mean 

S.D. « 

6 . Educ ational Grade Completed 

Less than 9 
9 V 
10 

11 • 
High School/GED 
Post Secondary 



54 
28 



82 

v 



.0 
.58 



6% 
62% 
32% 



'79% 
5% 
1% 



6 


7% 


5 ' 


6% 


13 


• 15% 


6 - 


7% 


46 


53% 


11 


13% 



- 1 



NOTE: Percentages do -not sum to 100 due to missing responses. 
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Table 22 (cont inued) 
N 



t Distribution of Participant Characteristics at .Intake-: CPEC 

CPEC 



Characteristics 



% 



(n = 87) 



7. ABLE Reading Score (Grade Level) 

3 - 4.9 
5-6.9 
7-8.9 

• 9 
Mean 
S.D. 

8. Ever Enrolled in Training Program 

Yes 
No 

9. Ever Held Full or Part-time Job 

Yes 
No 



, 0 
' 1 
10 
47 



8.85 
. .43 



41 
46 



71 
16 



10. Joh Holders Who Worked During 1 
32 Months Prior to Intake 

Yes -53 
No- . 18 

.11; Hourly Wage of Last Job Ever Held 

Mean, _ 
S.D. 

12. Hourly Wage o/ Last Job Within 12 Months ' •'; 

Mean A 
S.D. " 

13. Hours Worked per Week on Last Job Ever Held 

Mean 
S.D. 

14. Hours Worjed per Week on Last Job Within 12 Months 

IF 



$ 3.43 
.68 



$ 3.43 
.68 



36.0 
8,5 



Mean 
S.D. 



36.6 
8.5 



0 

2% 
17% 
81% 



47% 
53% 



82% 
18% 



75% 
25% 



These reveal that over 80% of the youth read . at a "nipth 
grade plus" level with only a single participant reading 
below the seventh grade norm. Of the full" sample (ri=87) , 
over 65% had graduated high school and eleven of these 57 
youth reported ■ post-high school education/ In fact, GPEC 
yoath appear more educationally competent than the youth in 
any of the other programs in this study, .In terms of c -work 
experience, six of ten participants youth had held full-time 
jobs within the year preceding their intake and almost 50% 
reported participating in employment training programs • 

Perhaps even more than MTTPY' yputh, the older, compara- 
tively well-educated and experienced CPEC population ap- 
pealed' capable of mastering the . technical aspects-of energy 
conservation training. * * 

Classro o m Training Phase;* . (?EEC 

The new enrol lee was first con fronted wi th an eight week 
classroom experience that was' evenly apportioned • between 
lectures and applied instruction. * Training was conducted by 
two private firms: EC ON -in Boston and Wescorp in the Border 
Region. Both firms manufactured energy saving devices in, 
addition to offering t.rairiing ; - Besides remedial and job 
readiness training, the following areas were addressed: 

• basic energy theories and conservation 
ppportunities; 

• heating , venti la t ion , and lighting systems ; 

• .building maintenance and construction practices; 

• control systems (e.g. thermostats, humidity 
controls) ; and , 

• alternative energy sources and systems. J . 

While in theory, a solid grounding in the basics is 
critical, in practice over one .third of the enrollees 
dropped out of the program' during this phase and overwhel- 
mingly thes-e youth were from the Border Reg ion , includ ing 
six New Hamphire youth who ,were pulled' out and reassigned to 
other CETA ^ogjams because of transportation difficulties. 
Transportation problems aside , . participating agencies 
pointed fingers at each other in -explaining the program's 
inability to hold youth. TDC staff aric3 trainers felt that 
most participants '>ere drifting" and not prepared to commit 
themselves to, a career; better screening, these sources 
claimed, would have gone far to remedy the problem. Prime 
Sponsors t believed the program design, with its heavy Class- 
room component , d i scour aged out -of -school youth. Further , 
Border . Region trainees, although competent craftsmen, had 
'difficulty relating to the typical enrollee. A fuli^-time 



counselor was added to the Border Region' staff to deal with, 
personal and vocational problems , but retention did not 
noticeably improve. 

Work Experience/Advanced Classroom Training; CPEC 

.The second phase of the CPEC se^Bence was a ten week 
period consisting of equal portions of' wor-k experience -and 
classroom time. Similar to the earlier phase, youth re- 
ceived a minimum wage stipend that was paid hy the Prime 
Sponsor,, Employers were lined _up in advance to provide 
youth' with hands-on work such as energy auditing , insula- 
tion, and retrofitting. > 

m The clasroom e\ipt . ience was devoted to skill development 
jln conducting and writing energy audits , understanding 
utility bills and -meter reading/ and job estimation/ In 
.addition, training was offered in crew supervision and 
salesmanship. A half-day per week was set^ aside for job 
acquisition training which emphasized 'researching the j6b 
market, goal setting, crystallizing job expectations, and 
j ob find ing . * , 

v As with the initial classroom phase, \=he work exper- 
ience/advanced training component ran into problems. During 
the plaffhing phase of the project, CPEC staff elicited 
verbal promises from employers to provide work experience 
for trainees. Program correspondence to P/PV in early July 
1979 noted thit about 150 employers had been identified and 
"personal contacts .have yielded assurances of Sufficient 
jobs, OJT contracts, and Work Experience placement s , ; to 
absorb all enrol^ees." However, close contact was .not 
maintained with employers and, in Boston, two thirds reneged 
on their promise to provide work experience for the first 
wave of youth. As a result; a part-time job developer w^s 
hired but as it turned out only twelve of twenty-three 
students achieved pr ivate * sector work experience. The re- 
mainder were divided into crews to perform auditing and 
retrofitting jobs- for non-profit organizations , under the 
supervision of ECON staff or a staff member from the non- 
profit. Performance improved marginally in Cycle II when 
ten cf nineteen candidates were placed in work experience 
positions with private sector employers. 

In the Eordar Region, four of ten youth placed in Work 
Experience quit and in . the second Cycle this component was 
scrapped ' entirely as youth moved directly from basic class- 
room training into OJT contracts. Wages seamed to be the 
problem with the work experience component. Trainees worked 
side by side with employees making $8.00 or more per hour 
.while the trainees received a minimum yhqe stipend from the 
Prime Sponsor. 



There were also s.erious substantive dilemmas with re- 
gards to curriculum content^ - Part of the optimistic fore- 
cast- "that predicted jobs-a-plenty in the energy field was 
predicated upon the adoption of the impending National 
Energy Policy and Conservation Act. which would have' Required 
regulated utilities to offer their customers energy' audits. 
The original ' curriculum was tailored to the job functions 
inherent in carrying out the. legislation . When the bill did 
not pass, CPEC planners were forced* to return to the drawing 
boards am<3 draft a- curriculum that would be relevant to the 
demand of an unsheltered market. However, the Department of 
Labor had instructed the program to avoid training in areas 
including TDC ' s first choice, HVAC , (heating , ventilation, 
and air conditioning).' Further, the 'DOL specified that TDC 
skirt areas in which private sector firms were explicitly 
involved. Because this was a demonstration project, DO L 
wanted to test new training content areas.^ TDC believed 
that .the edict to "find:, something that the private, sector 
isn't doing" .translates to "find something that the pri\^te 
sector "doesn' t need." . Ip the end, according to top TDC 
representative, "we were .hedging and not- sure what category 
would have jobs so we ttied to cover the water with every- 
thing from sales to installation." , 

OJT Phase: CPEC ' j 

CPEC originally projected that 38 youth would .engage in 
fin-the-job training .contracts; . 15 did. Of course the high 
drop-out rate earlier in the .program meant that not as many 
youth progressed to the OJT stage, but ether conditions also 
plagued OJT placement. First and- foremost, the economic 
downturn had vastly -reduced the demand for jobs. Across the 
nation, the'- scarcity o'f dollars for capital improvements 
deterred investment in the field of energy conservation. An 
informal survey conducted by CPEC in late 1979 attested to 
the shrinking job market as employers generally indicated 
that demand had slackened and there was simply not enough 
work to warrant taking a youth into training. To compound 
the situation, several employers said that the CPEC youth 
sdmply were not as well qualified. as others seeking the same 
jobs. In one* employer ' s words, CPEC training "was neither 
specific nor intensive enough to meet "bur needs." 

Job Placement 

The original CPEC model, like MTTPY, was based on a high 
demand for employment of its trainees * and both models had 
underestimated the need for placement services. CPEC hired 
several additional job developers to provide stepped-up 
placement assistance for program graduates and local employ-' 
ers were intensively canvassed. However, by the end of July 
198-0, nine months after startriip, nearly half of the enrol- 
lees had left the program, most as nonpositive terminations. 
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A TDC of ficial. perhaps best summai the program |s experi- 

ence: "We'd predicted easy ^rt» a to jobs and rapid 
advancement , -.but it didn't work - th: (tand is not therel" 

In summary, both programs suffer^, ecause the presumed 
demand for workers in boun the machiu. trades and energy 
conservation evaporated . Jobs in general were scarce and 
youth had to compete with a large number o'f ski lied workers 
who were unemployed . MTTPY was so/newhat, successful in 
coping with this problem and., as will be pointed out in the 
next, chapter, achieved a respectable job placenfcent . rate. 
TDC failed dismally in its effort to place youth in jobs. 
In addition to market fluctuation, TDC ' s extended classroom 
phase may have discouraged youth and contributed to the 
program' s high drop-out rate,.* Further , the lack of close 
and ongoing contact with employers hampered TDC's ability to 
place youth in work experience and OJT settings . MTTPY, on 
the other hand, with* its employer sponsorship component, was 
able to : enlist and sustain employer involvement, a critical 
element in transitioning youth into jobs.- 



, CHAPTER XII: TERMINATION ANALYSIS : 
MTTPY AND CPEC 

. * * 

This analysis corresponds to the approach taken in Part 
I. Our treatment of termination- information begins with an 
analysis of the termination status of participating youths 
and uses the same categories defined earlier: job placement/ 
other ; positive, nonpositive/ and other* This section also 
addresses the degree to which job at termination was related, 
to the specialized training of MTTPY and CPEC and concludes 
with - a brief comparison of termination data from other 
similar programs. The next section uses frequency tables 
and multiple regression analysis,, to explore '> program com- 
pleter vs. non-complete?r outcomes at termination. The'fin.al 
section employs multiple regression analysis to estimate "the 
effects of hours of program participation on employment 
status at termination. 

Termination Types * 

Table 23 presents , the number 4 and percent of participants 
by category of termination^ m 



Table 23 

Youth Status at Termination,: MTTPY and, CPEC 

— — * — ; B 

MTTPY CPEC 

19 22% 

12 14% 

49 57% 

6 • 7% 



86 .100% 



Job Placement 
Other Positive. 
Nonpositive 
Other 




45 


41% 


18 


17% 


40 


' 37% 


_6 


^5% 


109 


• 100% 



The cQntrast between the two programs is apparent. 
MTTPY clearly outperformed CPEC in terms of overall^ posit ive 
termination rate (53% vs.^36%) an<3 job placement rate (41%^ 
vs. 22%). CPEC's high drop-out rate and the shrinking- job 
market are reflected in the program's 57% nonpositive termi- 
nation rate. CPEC's inability to- link youths witjn jobs is 
further illustrated by the fact that eight of the 19 jobs 
were not in fields related to CPEC's training. The rela- 
tionship of job content to training curriculum is eSpecialy 
pertinent in specialized/ highly technical programs because 
these programs gra often three to four time as expensive-*, to 
operate as other programs that do not provide skills train- 
ing, if the subsequent job placements do not relate to the 



training , these extra expenditures may have* been wasted . 
For MTTPY youth who obtained jobs, 44 of 45 were in the 
machine trades. The latter statistic^ together with MTTPY' c s 
41% placement rate, suggests that < in spite of a very tight 
job market, the program performed well. Perhaps part of 
this is due to the choice of occupations. The machine 
trades are certainly essential to an industrialized society 
whereas data from several studies indicated that private 
investment in ; energy products , and services* wanes during 
economic downturn's. • Scarce dollars are more apt' to be 
invested in ' core goods and services. This suggests % that" 
employment and training policy makers would be better off 
-assigning public dollars to established industries exper i- 
encing skills shortages as opposed ,to new markets which are 
more sensitive to economise fluctuation . 

Termination data alone, however, are not sufficient 
indicators .of' program ef f ect iveness v . Unfortunately, with 
respect * to MTTPY and ; CPEC, cost constraints precluded 
follow-up ' research. m Therefore, we are left with gross com- 
parisons which are ' instructive but. not conclusive. On a 
national level, according to DO.L, participants in Youth 
Community ' Conservation and Improvement Project programs 
recorded an 18% rate of jobs at termination during fiscal 
year 1980,. which is •slightly less than CPEC and more than 
50% less than MTTPY. ^ 

Perhaps a better comparison is with selected youth pro- 
grams that -accented skills training. Aggregated data from 
three selected demonstration programs are^, exhibited in Table 
24. The programs-' include :* ^ 

. e the -Supported Work Demonstration which offered ^ 
•skills, training in a variety -of occupations ancl -« 
operated in fifteen sites, 

• the Ventures in Community Improvement Demonstra- 
tiorf^VlCI) wt^ich used union- journeymen to trfcin , 
yo'uth in .'construction trades and operated in , 
eight sites, . - 

. • *f our HUD demonstration projects which "also 
txained youth in the construction trades. 

We stress that these "compar i son's are limited and are not 
sufficient, to draw ,def inltive conclusions because of impor- 
tant differences among prograp populations and objectives. 
For example, the ' Supported Work program addressed a popu- 
lation with much more- seribus employabd lJfcY problems as evi- 
denced by the fact that half the yoxrfns had some contact 
with the criminal justice system; HUD, on the other hand, 
' was the only program to enroll in-school ydtath. and these 
students were counted <as positive, term inat ions if they 

• ii - • • ioj ■• '. • ' . 
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Table 24 



Comparison of MTTPY and CPEC Termination Types 
With Selected Youth Skill Training Programs 



Program 

Supported WorK 
(Youth 'Segment) 

VICI ' 



HUD 



' CPEC 



MTTPY 



% Job 

Placements 

z 

29 % 



33% 
19% 
22% 
41% 



<% Positive 
Termination n 

32%' ' 1,183 



44% 1,183 

6.1% 1,102 

36% . 86 

' -.. 

58%" 109 



.Time 
Period - 

(7/77 to 
. 6/7 8) 

(1077 9- 
9/80) 

(10/79- 
• 9/80) 

(10/79- 
. 11/80) 

.; " 10/7 9- 
10/8*0* 



remained in school. Nonetheless, these gross comparisons 
point -up CPEC's £oor job placement rate as well as MTTPY 1 s 
relatively high performance 6n .these measures. ..MTTPY 
clearly achieved the best job placement rate (41%). MTTPY 
almost equaled JIUD's positive termination rate, which is 
especially noteworthy ^ince 74% of the HUD participants* were 
in-school youth. 

This brief look at a few alternative programs suggests 
that the MTTPY program was successful. However, as noted, 
the comparisons are imperfect at best. 

Completers vs» Non^bompleter s 

Table* 25 shows that completers in the programs fared 
much better than non-completers. Completers in MTTPY were 
almost twenty times as likely as non-completers* to secure a 
job at termination. F.or CPEC completers, th^ ratio <was 3.5 
to l.,The qualitative evaluation suggested that many noncom- 
pleter s left each program to go into other -job training 
offerings. Across both programs, about one in five (18%) of 
those youth who left prematurely transferred to alternative 
training . ■ « 



Tabl£ 25 



MTTPY and CPEC Completers vs. N on-completers : 

Termination l zatus 



MT*tPY - CPE v^ Combined 





Com- 
pleters 


Non-com- 
pieter s 


C6m- 
V;pleters 


Non-com 
pleters 


Com- 
pleters 


Non-com 
pleters 


In Jobs . 


•7 8/% • 


4% 


58% 


16% 


74%' f 


11% 


In School 


" -0- 




-0- 


1% ' 


-0- 


1%- 


In Training 


-0- 


21% k . 




15% 


-0- 


18% 


In Military 


-0-7 


-0- ... 


-0- 


-0- 


-0- 


-0- 

0 


Total 
-Positive 


78% ♦ 


25% 


v, 5 8% 


32% 


74% 


3,0% 


To£al n 


54 


6 7 


23 

1 


74 1 


tt 64 


141 



r. Since completioi^ 6f the program appears to affect out- 
come at termination we estimated the key determinants of 
length of program participation. .Table 26 presents our D 
results.* Remaining 'in the MTTPY program was most attractive 
to the more competent participants. Both the high Sphool 
degrde and reading l^evel'were significant in explaining" 
hour^ of participation in the 'program. No such cXear re- 
sults were evident in the CPEC program. No explanatory 
variable signi fican-tly \a£fected length of time in the. CPEC * 
.program. \ * * " ^ 

Another interesting' finding from ttese hours- of partici- 
pation equations is that white youth tended not to stay in 
the MTTPY- grog ram. One explanation could be that since - 
whites represented only 12% of • the initial " participants," 
they found themselves *in the distinct minority and^decided 
not to stay. - * ■ . 

Effects of Hours of Program Participation , 

Multivariate . analysis was 'also used tp determine the 
effects of 'hours of program participation on the probability 
of being' employed at termination. Variables we controlled 
-for included age, sex, ethnicity, education, ABLE reading 
score/ and pre-program job. within 12 > months of intake. 
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As was true in the subsidized wage programs, for both 
the MTTPY and CPEC demonstrations, hours of program partici-' 
pation is a significant determinant of }db-at termination 
(cf. Appendix Table C-l) . It is,, in fact, for both model's 
the only variable that is s. -<riificant in explaining job at 
termination. In all probability , the fact that participants 
who remained for the duration of the program received in- 
tense job placement help from" sta-ff (while premature drop-, 
outs did not)/ accounts for their success. * 

• » 

Summary > 

MTTPY clearly out-performed CPEC in terms of both posi- 
tive termination rate ('58%' vs. 36%) and "job placement rate 
(41% vs. 22%). MTTPY 1 s job placement rate compared quite 
favorably with other federally-funded programs .aimed at 
providing skills training to disadvantaged youth. MTTPY 
also out-per formed CPEC in placing youths in jobs directly 
related to the training they received. * In MTTPY, 9 8% of 
program completers, but only* 36 percent of program enroll 
lees, were placed in training related occupations. In CPEC, 
58% of program completers, but only 11% of program en^l'lees 
obtained a job* at termination which was related to training. 

Multivariate analysis determined that a high school 
degree and high reading score bQth positively affected hours 
of participation* in MTTPY, ind i eating , that more capable 
youths tended to remain *iri the program. No such results 
were evident for CPEC. Multivariate analysis also indicated 
that hours of program participation significantly affected 
probability of employment at termination for both the MTTPY 
and CPEC programs. 

In conclusion, evidence suggests that the MTTPY program 
had a positive impact on participants. Definitive answers 
to this question cannot be obtained, however, because of the 
lack of a comparison g-roup. 
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« CHAPTER XIII : 
COST-EFFECTIVENESS: MTTPY AND OPEC 



Cost-Effectiveness is handled in the same manner in this 
chapter as it was in Part I. Agaip, the absence of com|- 
pari son ^groups and follow-up information precluded the use 
of cost-benefit analysis. Therefore, a series of unit costs 
(e.g., cost ' per job placement at termination) ere used to 
estimate how MTTPY and CPEC compare to other publicly funded 
skills training programs for youth. The methodoloy here is 
identical to the earlier one which used figures drawn frqm 
typical operating periods of each program. Specific re- 
search costs were netted, out. These amounted"'to 5%/of 
CPEC^s total expenditures and 10% of MTTPY 1 s , exclusive of 
youth stipends-. ' .Cost figures-"* derive from -each program l s.^. 
accounting records f and hence are subject to -some variation 
depending upon local -accounting practices? 

Results and Discussion 

The unit costs presented in Table 26 were computed using, 
formulae identical to those in Part I., 

Table 26 



Unit Costs: MTTPY arid .CPEC* ^ ^ 

4 

' MTTPY . CPEC 
Cost Per Participant $ 2, 538 ($1,410) $ 5,475 ($3,154) 

Cost Per Participant . , ; 

"•Year * $10,152 ($5,640) $13,140 ($7,572) 

• '\ ~~ 

Cost Per Positive •/ 
Termination ¥ ; •$ 5,266 ($2,923) $21,058 ($12,124) 

Cost Per Unsubsidi zed 
Job $ 5,417. ($3,007) $42,118 ($24,249) 

*N.umbers in parentheses are unit costs without youth stipends.. 

-> . 

Note: See Appendix D for a cpmparison of these cost figures with 
those derived without using the typical operating period-. 
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In order to provide a wider context, Table 27 displays 
unit costs from several other youth program that featured 
skills training. However/ these ^unit costs are hot pre- 
cisely comparable. They defcive from various reports and 
interviews with* other researchers. Also, service popula- 
tion^ and * objectives vary across the programs. These fig- 
ures are includedi only to present a rough fiscal profile of 
existing .programs so that the unit costs of MTTPY and CPEC 
can be grossly compared and weighed. Figures include sti- 
pends paid to participants. 7 • 

CPEC expended less than most of the mother 'programs on a 
cost per participant basis. However, the usefulness of cost 
per participant measures .is limited since high turnover 
rates and brief lengths of stay may provide the illusion of 
ef f ic iency w,i thout providing impact. * A better measure of- 
service rendere^T is "cost per service, year" which is fairly 
simi lar ' across the programs, but also falls short o£ cap- 
turing the program impact upon participant employment £nd 
employabil i ty'. Because there are no long-term^ data, - our- 
best measures of cost are cost per positive termination and 
cost per unsubsidized job. * On both/ of these measures, the 
MTTPY program outperforms all other programs, in most cases 
by a wide margin-. MTTPY is several times less expensive 
than the Job Corps and the Ventures fn Community Improvement, 
Progr'am, both of which report that participants 1 long term 
benefits substantially outweigh program costs. CPEC, on the 
other hand, was. more expensive than aqy other program except 
for the Supported -Work Demonstration. (The analysis of the 
long-term fiscal impact of the Supported • Work Demonstration 
also found that costs ^.exceeded benefits.) 

Al though firm conolus i ons cannot be drawn because of 

data, limitations, these findings rjeflect positively .on^the 

cost-ef f ectiyeness of the MTTPY program relative to /other 
skill training programs * f or youth . 

CPEC 1 s poor .performance in recruiting, holding,and 
placing youth* is obvious in the^'cost figures.. While its 
costs per youth served and per Service year are consistently 
greater than MTTPY 1 s , CPEC's co£ts soar with the measuring 
units that focus on termination outcomes. Especially trou- 
bling is the cost pe$ unsubsidized j'ob which ^exceeds $40, 000 
and wh i ch' i s compounded when we r eca 1 1 tha t many j obs were 
not energy-r elated . Indeed, if unit costs, in CPEC were 
restricted to energy-related job placements, costs would 
reach almost $60/000 per job placement * , . ' \ * 
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Table 27 



Unit Cost Comparison 
Unit Costs: Selected Youth Skill Training Programs 



Ventures in 
Community ^ 
Improvement 

2 

Supported, Work 
(Youth Segment) 

3 

Job Corps 
YCCIP 4 
CPEC 
MTTPY : 



Cost Per 
Participant Year 



$ 8,598 

£ 7,384 

$ 6,597 
$ 2,985 
<? 5,475 
$;.2, 53 8 



Cost Per~ 
Cost Per Positive 
Service Termina- 



$13,193 
$ 7,793 
$13,140 
$10., 152 



tion 



$11,593 1 $19,537 



$13,115 $41,022 



$13,545 
$ 6,703 
$21,058 
$ 5,266 



Cost Per 
UnsujDsid- 
ized Job 

£22,403 



NA 

NA 
$21,785 
$42,118 
$ 5,417 



A demonstration program in whicE^imion journeymen trained 
economically disadvantaged youth in the construction trades by 
working on community improvements, (cf. P/PV/ > T9^2) 

A demonstration^ program which trained economically disad- 
vantaged youth (and other groups with employment problems) in^a 
variety of occupations, (cf. Manpower Demonstration Research^ 
Corporation, 1980. ) / — 

3 

A program which offers a complete range of education, 
training, "and support services, usually in residential setting, 
„to economically disadvantaged youth. (cf. Employment and 
Training Report of , the President, 1981 and Taggart, 1981.) 

4 Youth Community Conservation and Improvement Projects which 
provided subsidized training in community-planned work projects 
and received formula funding, served 16 to 19 year olds, with 
preference given to low-income youthjs and high school dropouts, 
(cf* Employment and Training Report of the President , 1981 and 
Taggart, 1981.) 
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CHAPTER XIV; SUMMARY AND FINDINGS ON 



OCCUPATIONAL ACCESSING STRATEGIES 



In this chapter we briefly summarize principal findings 
of interest to policy-makers and program operators. Because 
of the absence of both comparison groups and follow-up data, 
the remarks are limited to a qualitative evaluation of 
program operations and to certain cost and termination 
comparisons with similar programs in the employment field. 

Pol icy Impl icat ions 

The learning gleaned from CPEC primarily consists of a 
litany of caveats. The program clearly failed and several 
factors appeared to influence its poor performance. As Jthe 
next section points out,, the program design was faulty, j At 
a more global lea/el, however, it is questionable whether 
policy-makers should commit resources to skills training in 
emerging, and hence, volatile 'industries which are extremely 
sensitive to shifts in the economy. • j 

In the base of MTTPY, the results are more promising . 
Despite the sudden down-turn in the economy which l.eft 
numerous machinists out of work, the data for the program 
are impressive. MTTPY positively terminated 58% of its 
participants with 41% gaining unsubsidized employment. 
Further, MTTPY secured 41 of its 45 job placements within 
its targeted occupational area: machine' trades. These rates 
clearly surpass many other skills training programs for 
youth. 

Compared to national program data, MTTPY 1 s unit cost are 
favorable. Its cost per unsubsidized job placement was 
$5,417. The two other comparable programs that reported 
this statistic, YCCIP and Ventures in Community Improvement, 
spent approximately $21,000 per job placement. MTTPY 1 s cost 
per positive termination was $5,266. In contrast the Job 
Corps Wc\s found to cost $13,545 per positive termination 
with YCCIP at $6,703. 

Several implications for policy flow from these find- 
ings. First, it appears that designed skills training 
programs can work ^or youth, although the absence of longi- 
tudinal data, precludes definitive answers on post-program 
outcomes . Second, despite a wrenching down- turn in the 
Cleveland machine, trades, MTT PY 1 s occupational area was 
somewhat less vulnerable to, the state of the economy at 
least compared to new fields such as energy^ conservation. 
Finally, MTTPY f s relative success appearecf to rest upon 
several solid programming principles, such as in-depth 
diagnosis and screening, early and continuous private sector 
involvement, a well-balanced curriculum featuring cognitive 
and hands-on learning, and qual if ied 1 instructors, including 



retired union ^machinists who could relate to youth and who 
had personal networks of job contacts^ 

Oper:a t i ona 1 Ana lys i s / ' 

Both MTTPY' and CPEC featured a multi-step training 
progression. Althaugh similar in many ways, the design and 
execution of the MTTPtf model was clearly ^superior. Its 
initial month-long phase, "Diagnostic and Career Prep," 
seemed to yield several positive effects .* First, it sys- 
tematically and effectively helped youth sharpen basic 
skills via its modular competency curriculum. In addition 
the Prep phase wa^s Used to inform youth about the machine 
trades and offer y pre-employment training. - Equally essen- 
tial/ this introductory period was used for secondary, 
screening. Through testing and observation, inappropriate 
candidates were identified and referred to other training 
offerings and the special needs of certain participants were 
addressed. The proficiency requirement/ wherein youth had 
to attain specified cut-off scor.es before advancing to the 
next stage served "as an r effective, quality control. 

The month-long Prep phase was followed by a combined 
hands-op and classroom training stage where trainees soon 
.began nfachin.ing their -own products. Such a .design provided 
participants a steady stream of positive reinforcements as 
they mastered learning modules and produced tangible out- 
puts. CPEC/ on the othei^hand/ began with a two-month long 
classroom- training phase which was .highly cognitive and 
appears to have discouraged, many .^uth 

Both programs embddied worJ$, exper iehce ^components with 
private sector employers. MTTPY inv61ved employers directly 
by introducing them to their prospective trainees early in 
the process and keeping employers updated on the trainee's 
progress. CPEC/ on the other hand/ .after enlisting employ- 
ers failed to keep them involved with the program. Mapy of 
the employer pledges were withdrawn* several months later 
when CPEC sought to place, the trainees. 

Finally /. with the exception of the Prime Sponsor hand- 
ling recruiting and certification/ MTTPY was run by a single 
agency with experienced staff. Irr contrast/ CPEC's' division, 
of labor ' ^With -various agencies taking responsibil ity for 
different program phases proved unwieldy and less than 
efficient . - 
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Table A-l 

1 t 

\ * 

Probit Analysis of Employment '-Status and 
Positiye Activity Status at Follow-up: OR 
t- ratios in parentheses) 



Va<riabl 




Employment Status Positive' Activity 



Age at Intake 
1 = 18 or over 



• -.02 
(-.06) 



• .34 
(.90) 



Sex 

1 = male . 

Ethnicity 

1 = Hispanic, 0 otherwise 

i 

1 = black, 0 otherwise 



-.40 ' 
(-.90) \ 



1.02 
(2.21)* 



.33 



(whitee is omitted category) (.46) 
Education 



1 = high school 
graduate ' 

ABLE Reading Score 



Pre-program job within 
12 months of intake 

1 = yes 



Hours of program 
participation 

Constant 



-.-54 
(-1.16) 

.05 
(.45) 



. .51 
(1.35) 

.0007 
(1.13) 

-1.11 
(-1.31) 



.15 
(.34) 



.72 
(1.62) 

,-.10 
(-.16) 



' .14 
. (.29) 

-.04 
(-.42) 



.36 

(..96), 

.0004 
(.58) 

-.54 
(-.64) 



Chi-Square 13.4 9 

Degrees of Freedom 8 
Proportion y=l .52/ 
Log Likelihood -35.46 
' Number of Obser- 61 
vations 



8.91 
8 

' .61 
■36.43 
61 



♦indicates statistical significance at .05 level 



Table A-2 



PROBIT ANALYSIS OF EMPLOYMENT STATUS 
POSITIVE ACTIVITY STATUS AT EOLLOW-UP: 



AND \ 
PO I 



Variable 



(t - ratios in parentheses) 

Employment 
Status 



Positive 
Actjyvity 




Age at Intake 
1 =18 or over 

Sex . ; 

1 = ijiale * 

Ethnicity 
1 = white 

Parents' Education 



Education 

1 = high school 
graduate 

/ 

ABLE Reading Score 



Pre-prbgram job within 
12 months of intake 

1 = yes 



Hours of program 
' p articipation 



(£.,74) 



.47 
(1.33) 



07 
(-.10) 

.02 
(.07) 



. 13 
(.36) 

.22 
(1.48) 



. 30 
(.89) 

. 0002 
(.52) 



.47 
(1.30) 



-.55 
(-.75) 

.06 
(.27) 

/ 



-.10. 
(-.28) 

.23 
(1.59) 



.-07 „ 
(.20) 

.0005 
(1.10) 



Constant 



-2. 00 
(-1..30) 



-1.82 
(-1.32) 



Chi-Square 6.87 
Degrees of Freedom 8 
Proportion y=l .49 
Log Likelihood -44.38 
Number of Obser- 69 
vations 



8.34 
8 

.57 
-43. 07 
69 
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APPENDIX 'B 
, CONTROLLING FOR SELECTION BIAS ' 

As indicated in Table 10 of the Impact Analysts chapter,' " 
• our overall comparison group for the Project Oppbrtunity 
Phase i program has slightly higher .values on baseline 
characteristics such as proportion wi'tfh a high schcjp.l de- 
gree, reading ability score, proportion with * pr,e-program 
job,° and wages on pre-program job* " ' 

> » * 

These differences between our* comparison, group and our .. 
participant' group cause no problem, as long as all- of the 
differences between the groups are ' observable. The purpose* 
of our multiple regression is to control for differences in 
background characteristics between. samjJi^groups . However, 
if as appears to be the case; program stVff were selecting 
certain types of youth for program participation, there were 
probably unobservable differences between ,the sample groups 
working in the same directidri as the observable differences. 
Traditional regression . analysis cannot control- for such 
iinob&ervable differences. fc 

\ I ' ' ' ' 

r^n an . attempt to control for thesfe unobservable dif- 
ferences between the * 'par ticipant - and comparison . grotfps , we 
make use of a recently developed econometric procedure which 
controls for selection *bias in- the . estimation of prcgraim ? 
effects. This' procedure involves a two stage methodology 
which attempts to capture unobservable character istics which 
affected selection into the progr'am. In the first stage of 
this analysis, selection into the program is modeled based 
on various observable differences between sampie individ- 
ual's. From this model, conditional probabilities of partic- , 
ipation based on observable cha'rcFbter istics can be estimated 
for each individual. Differences between the predicted and 
actual participation status of each individual can then.be - 
attributed to unobservable individual characteristics^ In 
the second stage of this analysis, program effects on out- 
come measures are estimated, controlling f^pr observable 
differences as well as an extra variable representing the 
unobservable characteristics of the individual which appear 
to affect" program participation, as estimated in the first 
stage. To make these models work, the "selection equation 
must be distinguished from the outcome equations. To do- 
this, an additional variable must be added to the selection 
equation which i s related to selecti on into the program but 
not to any of • the outcome measures. 

Our attempt to model sample selection • in the Project 
Opportunity Phase I program is complicated by the fact that - 
the comparison group included youth who were selected out of* 
the program either because they were too job-ready or not 

u? 
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job-ready enough./ To make a more straightforward selection* 
model , we tried .deleting from the sample' the youth who were 
either in SuppoXted Work at the time'Of th<=> baseline survey 
or who eventually entered Supported Work. With these ybuth 
left out, we can at least hypothesize the direction that our 
selection results should take, and thus determine if our 
selection model is working as expected. 

Table B-i presents the results of our program selection 
model usiftg bo-th our overall compari-son sample and the com-| 
parison sample wi'th the supported work you\H deleted. The 
variable that we use to /identify the selection equation 
ihclude the , town of residence of the individuals in the 
sample and the quarter of intake* into the sample. Partici- 
pant and comparison gtfoup memhers in our sample came from 
thrsfe geographically close town's in Wisconsin^ Fond du Lac, 
Oshkosh, arid Neenah. Because the three towns 'are all within 
twenty tmiles" 0:6 each other, it can reasonably be assumed 
that they are all part of the same labor market, and that 
the home town of each youth .should -have no effect on his 
labor market success." Similarly, it can reasonably be 
assumed that the ,qiiarter in which youth entered the sample 
should have no relation, to subsequent labor market outcomes. 

As is evident in' Table B-l, our selection model using 
the segmented^compar ison group fias t more explanatory power 
than our model using the entire 'comparison sample. In large 
.part, this is to be expected given that our segmented com- 
parison group is so much more obviously di f f erent , f rom our 
participant grotfp. " In the model uSigs the -segmented com- 
parison group, our city variable does Irairly well in identi- 
fying the selection equation. Individuals from Neenah have 
a significantly different chance of program participation 
than individuals from M Fond du Lac. In the selection model 
for both samples, the Quarterly variables are statistically 
significant in explaining program participation. 

Tables B-2 and B-3 present our outcome equations for 
earnings using first the overall comparison group and then 
the segmented comparison group.. The tables present results 
both wi th and without 'a correction for selection-* bias . The 
earnings results presented in Table 3-2 — using' the full 
comparison group with a correction for selection ,bias — are 
the ones reported in the text of our net, impact chapter." 

* 

In. our earnings results in Table B-3, our correction fo.r 
selection bias does, affect our results. Without the cor- 
rection, program participation has a si ightly negative but 
insignificant effect, on. subsequent earnings. With the 
correction for' selection bias included in the model/ program 
participation has a'^much stronger negative effect on sub- 
sequent elfrnings and the effect approaches statistical 
significance . * • i «j n ' 



Table B-l 



Probit Model of Selection into Project Opportunity I Program 



Variable j 



Age at intake 

1. = 18 or over 



(t-ratioj s in parentheses) 
< 



Sex 



1 .= male 



Ethnicity 
1 = white 



Education * 
1 = high school ^ 
graduate 

ABLE Reading Score - 

. ' 4 

Parent'^ Education Level 



Pre-program job within 
* 12 months of intake 



Neenah ' 



Qghkosh 



Entered in Quarter 1 



Entered i ; n Quarter 2 
\ 

Entered in Quarter 3 



Constant 



Chi-Square 
Log of Li kel ihood 
Proportion. Y=l 
t Degrees of Freedom 
Number. of Observations 



jarey ti 

With Overall' 
Comparison Group 



-.18 
(-.47) 



-. 13 
(-.51) 



-.05 
(-.07) 



.04 
(.15) • 

.-01 
(.01) . 

• -. 15 
(-".84) 

.04 
' (-17) 

,-.36 
(-1.37) 

.09 
(.26) 

-1. 57 
(-3.77)* 

-1.64 
(-4.18)* 

-1.45 

(-3.76) * 

-1. 98 .- 
(1.69) 

35.43 
-8 3.25 , 
■ £47 
12 
146 



With- Segmented 
Comparison Group 



-.29 
(-.70) 



-. 11 • 
(-144) 



-. 17 ' 
(-.23) 



.01 

'(.04) 

' -2.*0 
(-1.44) 

-'. 23 
■(-0-19) 



-• 01 ft 
(-.05) 

-. 53 
(-1.80) • 

: .11 

(.31) 

-1.73 
(-3.70)* 

■ -1.80 L 
,-3.92)** 

V -1.67 
\(-3. 81) * 

4. 53 
' (2.89)*- 

41.52 
-74.89 
. 50 

12 
138 



*Indicates statistical significance "at the .05 level 



Table B-2 



Tobit Analysis of Earnings, Full, Comparison Group , 
With and Without Correction for Selection Bias 
(t-ratio's M.n parentheses) ~~ 



Var iables 



With. , 
Correction 



Without 
Correction 



Age at intake 

1 = 18 or over 



Sex 



1 = male 



Ethnicity . 
1 f White 



lEducation 



\ 1 - High School Degree 
graduate 

ABLE Reading., Score 



Pre-prograjn job within 

12 months of intake 
1 



Intery ieW 


in 


2nd 


Quarter 


IntServi^w 


in 


3rd 


- f- 

Quarter 


Interview 


in 


4th 


Quarter % 



Program Participation 



Lambda 



Constant 



Sigma 



41.62 
(1.910 

5.82 
• (.39) 



-59. 50 
(-1.87) 



3.23 • 
(.20) 

1. 68 
(.26) 

45. 24 
(3.12"")* 

-.48 
(-.04) 

-10. 87 
(-.38) 

-8.66 
(-.30) 

35.86 
(1.27) • 



Mean Value of Y 
Number of Observations 
Log Likelihood 

♦Indicates' statistical significance at the .05 level 
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42.27 
(1.94) 

9.44 
C64) 



-54. 51 
(-1.72) 



3.86 
(.24.) 

2.73 
' (.43) 

48.26 
•(3.36)* 

2.24 
(.20) 

-12.79 •• 
(-.44) 

-8.18" 
(-.28) 

32. 57 
(1.16) 



-45. 73 
(-1.39) 




-10.35 
(-.73) 


26.03 
• (1.21) 


.1 

rr ' 




63. 65 
(.77) 




11.40 
(.16) 


69.94 
(11. 42) 
83.45 
146- 
-753. 16 




69.58 
(11.26) 
83.45 
146 
-753.74 



Table B^3 

* * * 

* Tobit Analysis of Earnings, Segmented Comparison Group 
With and Without Correction Jor Selection Bias 
(t-ratio's in parentheses) , 



Variables 



Age -at ; intake 

1 = 18 or over 



Sex 



1 = male 



Ethnicity 
1 =' White 



Education 

1 = High School Degree 
graduate v « 

ABLE Reading Score . , 



Pre-progjcam job within 
12 months of intake 

i 

Parent • s Education 



Interview in 2nd Quarter 
Interview' in 3rd Qfrarter 
Interview in 4th Quarter 
Program Participation 
Lambda 
Constant ' 
Sigma 

Mean Value of -Dependent 
Variable 

.Number of Observations 
Log Likelihood 



With 

Correction 



28. 09 
(1.21) 



1. 79 
(.11) 



-90.84 
(-2.58) * 



' : .35 
(.02) 

3.40' 
(.47) . 

48.81 . 
(3.29) * 

' .63 
(.05) 

. -8.19 -' 
(-.28) 

-10. 54 
(-.36) 

.39.25 
(1^3 8 )•> 

-59. 36 
(-1.79) 

36.87 ' 
(1.66) 

94.84 • 
(.99) 

70. 72 
(11.33) 

84.48 
136 
-711.21 



v. 



Without . 
Correction 



30.67 
(1.32) 

7.16" 
(.48) 

* ; 

78.76 • 
(2. 30) * 



2.63 , 
(.16) 

6.26 sj 
(.89) 

r 

52.37 
(3.55) * 

5.00 ' 
(.45) 

-12.93 
(-.45) 

-11.00 
(-.38) 

28. 26 
(1.20) ' 

-10. 80 
(-.73) 



19. 33 
(.23) 

70.34 
(11.09) 

84.48 
136 
-712. 33 



♦I-ndicates statistical ^signi ficance at the .05 level. 

lo; 



It is somewtfat troublesome thajt in both our model' using 
'the overall comparison and our model using the segmented 
comparison group, the correction for selection bias . makes 
the program Effect more negative. We had expected observ- 
able and # unobservable characteristics to work in the saifie 
direction iji.. explaining program participation. That this 
did not occur, sheds some doubt- on whether* our" selection 
model succesaf ully captured ally unobservable differences 
between- our participant and comparison samples. 

* IN 
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Table C-l 



Variable 



fcrobit Analysis Explaining 
Job at Termination: CPEC and MTTPY 

.(t-ratios "in parentheses) 

CPEC 



Age At Intake 

1 = 18 or over 



»3.69 
(-.06) 



MTTPY 



3-32 
(.05) 



Sex 



1 = male 



Ethnicity 

1 - black, 0 otherwise 

1 = white, 0 otherwise 

** 

(Hispanic Omitted' Category) 
Education 

1 = High School Graduate 

ABLE Reading Score 

Ho urs of Program' Participation . 



Pre-Program Job Within 
12 Months of Intake 



Constant 



Chi-Square 
Degrees of Freedom 
Log of Liklihood 
Proportion Y=l 
Number of Observations 



-.49 
(-1.02) 

r 

.001 
(.001) 

-.35 
C-.48) 



.09 
(.18) 

.02 

^(.03) 

.001 
(2.75) * 



-.15 
(-.34) 

-4.57 
(-.07) 

13.13 

8 

-28.52 
.29 
58 



-.13 
(-.41) 



-.03 
(-.07) 

.61 

(1.00) 



-.12 
(-.47) 

.04 
(.48) 

.002 
(2.33) * 



.43 
(1.54) 

-4.88 
(-.08) 

13.34 
8 

-71-U8 
. 36.. 
119 



♦Indicates statistical significance at the .05 level. 
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APPENDIX 6 

Typical 'Operating Period Versus Straight 
Computation of Unit Costs . 



The typical operating period technique used in this 
report bases all calculations upon a "representative" period 
during the mid-life of a program. Costs connected with 
program start-up are el iminated and a. better -estimate -of 
normal operating costs is thereby achieved. Also, the 
demonstration programs studied in this report exper ienced 
phase-out periods during their final months..; While a full 
staff was often retained during phase-out* no new youth were 
enrolled. Staff effort during phase-out was more fully 
directed towards the support and placement of youth, and 
'programs tended to achieve higher positive* termination rates 
during this period. Because phase-out costs are also a 
typical, the TOP technique' excluded them. 

In this appendix we demonstrate arid explain how unit 
costs can differ widely depending on their method of 
calculation. * In particular we contrast costs derived from 
the Typical Operating Period Technique (TOP) with those 
generated via a straight computation method (SC) . Further, 
we assess how the inclusion of start-up and phase-out costs 
differ from a program's normal running costs. 

Table D-l lists two sets of cost figures. m One set 
derived from the TOP method , and the other from SC*. the 
latter approach, unit costs represent the full life of the 
demonstration and were calculated by .simply dividing total 
costs (less research expenditures) by the sum of each key 
indicator. For example, the SC cost per unsubsidi ze<3 job jls 
the result of total costs divided by tdtal number &f 
participants achieving a job placement at termination. w * 

Scrutiny of Table D-l reveals numerous instances where 
substantial var-irance exists between the two methods of cost 
analysis. For. example, on the cost per ^participant measure, 
each TOP calculation %^ lower than its SC counterpart. The 
differences range in magnitude from $242 to $1,421 dollars. 
Using PO II as the "worst case" example (i.e. the highest 
variance), we see that the PO II "s cost" per participant 
(stipends ii^^ud^_i_„_usi.ng the TOP method was $2,276 while 
the— SttaT^TTCalcuiation waa $3, 697, a difference of $1,421. 
The running data show the ctfuse of discrepancy. (See . Table 
D-2.) The Typical Operating Period (TOP) ran from July 
through November 1981. Selecting this TOP was dictated by 
the fact tha,t both agency caseload (number of youth in 
process) and operating costs were stable from July through 
November. Admittedly, this period does not perfectly 
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Table D-l 



Unit Costs: Typical Operating Period (TOP) 



Unit Costs 



Cost per 

Participant 



Co^t per 
Positive 
Termination 



Cost per 

Unsubsidized 
Job 



SC 



TOP 



SC 



SC 







Programs 






po r 


PO II 


0R/NJ 


MTTPY 


CPEG 


$2961 
(975)** 


• 2276 " 
' (796) 


2804 
(1005) 


2538 
(1410) 


5475 
' 1 , (3154) 


,$3205 
(1323) 


3-697 
(1471) 


3282 " 
(1727) 


3311 
(2244) 


6018 
(4250) 


$7481 
(2464) 


45-71 
(1602) 


5792 
(2080)- 


5266 
(2323) 


21058 
(12124°) 


$6463 ' 
(2667) 6 


' 5934 
(2362) 


5707 
- (3004) 


7419 
. (5029) 


21061 
(14876) 


$10331 
(3403) 


5366 
(1880) 


7722 . 
(2774) 


54f7 
(3007) 


42118 
(24249) 


$10018 
(4033) 


7047 * 
(2805) 


, 7722 
(4064) 


8709 
(5904) 


32211 
(22751) 



* Research costs have been netted out fofr both computational methods. 
** Numbers in parantheses do not include youth stipends. 
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represent a typical period of operations. Intuitively f we 
are aware that certain seasonal effects may influence the 
data from this period because it excludes much of the winter 
and all of the spr ing . -Also the $2649 paid as stipends to 
youth in Novembefc is clearly atypical. Nevertheless f we 
argue that the TOP f although imperfect, is more 
representative of normal operating costs than the SC method 
with its inclusion of wind-up and wind-down periods. 

In the PO II example f having selected the TOP , the 
start-up period by definition ran from February through June 
1981 (See Table D-2.)' The wind-down period was December, 
1981 through March, 1982. Examination of these per iods 
permits us to analyze why the two methods of calculation 
yield different results. During start-up and phase-out the 
ratio of dollars spent to "number of youth in process" far 
exceeds the same ratio during -the TOP. Table D-3 illus- 
trates this^ and lists a number of additional statistics 
broken out' by project time period. 

Analyzing costs by pro j ect period brings to light the 
reason for variance between the two methods of calculation. 
For example, the average monthly costs of program ope~'^tion,* 
excluding youth stipends, is fairly similar for the s art-up 
period ($7114) -versus TOP ($8652) but the. monthly nurberof 
youth in process during TOP av.erages more than twice that of 
the start-up period.^ Cost per participant' calculations 
differ accordingly with costs running much higher during 
start-up. As, is evident "from line_9 in Table D-3 the ratio 
of operating costs to youth stipend -ncosts_ i s much lower 
during /the TOP which indicates more- service peir dollar. As 
one would expect, costs during the phase-out period" were 
much less than other periods. 'However, costs during 
phase-out on a per participant basis were the highest of all 
periods because the number of participants served decreased 
even more sharply than costs. - . 

• , * 

Similar analyses explain discrepancies between cost per 
positive termination. and cost per unsubsidized job 
placement. For example, Table D-2 notes seven positive 
terminations during phase-out while total expenditures (less 
11% research costs) totalled ,$10,949. Straight division 
yields a cost per unsubsidized job figure of $1,564 which is 
over $300 -less than the identical^ statistic for the TOP 
($1,1380). Decreased expenses . coupled with staff giving full 
emphasis to placing current participants probably explain 
this discrepancy.. 

In summary,, tare must be taken in calculating even the 
most basic of cost indicators. In this study, a typical 
operating period technique ' (TOP)' was used because it^ 
appeared to best represent normal program operation. 
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Table D-2 
Spreadsheet for' Cost 'Analysis 

Program 

Project Opportunity: Phase II 
■ [ < , \ \_ 

Period Month Expenses Positive Unsubsidized Job Youth_^ 

No Stipends Terminations Placements Proces 





2/31 


3293. 


$ 


5,501.74 


0 




0 


5 




3/81 


5114 


$ 


7,491 


1 




0 


10 


Start- 
up 


4/81 


6072 


$ 


8,957 


0 




0 

"* - / 


1 Q 




5/81 


10,774 


$ 


7,200 . 


1 




1 


z o 




6/81 


16 ,520 


$10,816 


•2 




1 


36 




7/81 


20 ,251 


$10,983 


1 




1 


45 


Typical 

perating 

Period 


8/81 
9/81 


21,822 
19,819 


$ 
$ 


9 ,585 
9,158 . 


3 
8 




" 2 
"5 


51 '. 
48 .' 




10/81, 


15,627 


$ 


9,425 


5 




6 


' 43 




11/81 


2649 


$ 


9,457 


10 




9 


30 




12/81 


6478 


$ 


3,522 • 


4 




■4 


12 


Phase 
Down 


1/82 
2/82 


5429 
1455. 


$ 
$ 


2,53~3 
2,744 


1 

2 




1 
2 


6 
5 




3/82 


.430 


$ 


3*, 503 


0 

/ 




0 


4 


TOTALS 




13,9022 


$100,875* , 


>- 38 




32 





* $100,875 less 11% research cost =,$89,779 
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Table D-3 
PQ I Project Period .Cost Data 

Start-Up 



XOP Phase-Out 



2/81 thru 6/81 - 7/81 thru 11/81 12/81 1 thru, 3/8 



(a) Total Active 9 8 ' 217 . 27 
Participant Slots 

(b) Length of Period in 

• Months 5 5 - J , 4 

(c) X Participants - 19.6 ' 43.4 5.8 
per Month ( a ^ b) 

(d) Total Operating $35,568 $43,261 $10,948 
Expenditures 

(11% research cost * 
netted out) 

(e) ^ Total Youth * $41,771 . $80,168 $13,792 

Stipend Expenditures • 

(f) Total Operating 0 $77>339 $123,429* $?4,740 
Stipend ( d+e) 

^Expenditures J • " fc - 

(g) Ratio of -.85 . .53 .79 
Operating to 

Stipend Expenditures ( d ^ e) 

(h) X Monthly Cost:" $ 7,114 $8,652 / .$2,737 
Operating Expenses \^ ' , 

( d f b ) 

(i) X Monthly Cost: $8,35.4 $16,034 ' $3,448 
Youth Stipends 

( e 7 b ) . 

(j) X Monthly Cost: $1*5,468 $24,688 $6,185 

Operations + * • v 

Stipends ( f f b) - 

& . 

(k) X Monthly Cost Per ^ 
Participant / ™ > 

( h - c) without stipends,. $363 ' $199 $403 

( j -l c) with stipends • $789 •. $569 $910 

(10 Cost per Participant 

(k x 4 month without stipend $1452 $796 $1612 

average stay) with stipends $3156 $2276 $3640 
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Statistics yielded from the TOP 'technique do vary, often 
substantially , with those generated by other techniques, **in 
particular the Straight, Calculation method; Much caution, 
therefore, must be used in interpreting and contrasting cost 
figures, especially those which compare different programs 
since different calculation techniques can yield widely 
variable results . 
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